-- Logs begin at Thu 2022-09-08 12:50:35 UTC, end at Thu 2022-09-08 14:22:02 UTC. -- Sep 08 13:51:53.557969 dv-cinder-856463-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 13:51:53.569559 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:51:53 2022] *** Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: nodename: dv-cinder-856463-2-iscsi Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: machine: x86_64 Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: clock source: unix Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: pcre jit disabled Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: detected number of CPU cores: 4 Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: current working directory: / Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:51:53.571389 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: your processes number limit is 47680 Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: your memory page size is 4096 bytes Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: detected max file descriptor number: 2048 Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: lock engine: pthread robust mutexes Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: thunder lock: enabled Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 13:51:53.572042 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:51:53.614333 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: Python main interpreter initialized at 0x5562fcf009c0 Sep 08 13:51:53.614333 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: python threads support enabled Sep 08 13:51:53.614333 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: your server socket listen backlog is limited to 100 connections Sep 08 13:51:53.614333 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:51:53.614889 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:51:53.614889 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: *** Operational MODE: preforking *** Sep 08 13:51:53.615261 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:51:53.615261 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: spawned uWSGI master process (pid: 112866) Sep 08 13:51:53.615517 dv-cinder-856463-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 13:51:53.617817 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: spawned uWSGI worker 1 (pid: 112879, cores: 1) Sep 08 13:51:53.617817 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: spawned uWSGI worker 2 (pid: 112880, cores: 1) Sep 08 13:51:53.617817 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:51:54.330364 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:51:54.363346 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 13:51:55.472377 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:55.472377 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: from cryptography.utils import int_from_bytes Sep 08 13:51:55.473082 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:55.473082 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: from cryptography.utils import int_from_bytes Sep 08 13:51:55.473489 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:55.473489 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: from cryptography.utils import int_from_bytes Sep 08 13:51:55.473616 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:51:55.473616 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: from cryptography.utils import int_from_bytes Sep 08 13:51:58.052160 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:51:58.052811 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:51:58.052969 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:51:58.053340 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:51:58.053597 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:51:58.053988 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.054317 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.054638 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.054958 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.055292 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.055604 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.055928 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.056275 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.056605 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.056867 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.057184 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.057543 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-2-iscsi {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.057865 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.058174 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.058484 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.058805 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.059107 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.059429 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.059856 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.060427 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.061842 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.061842 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.061842 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.061842 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.062460 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.062460 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.062899 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.063222 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.063556 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.063866 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.064305 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-2-iscsi {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.064632 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.064948 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.065282 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.065690 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.066007 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.066316 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.066638 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.066977 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.067290 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.067619 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.067940 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.068290 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.068668 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.068976 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.069285 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.069597 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.069918 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.070224 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.070536 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.070787 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.071097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.071421 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.071750 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.072071 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.072364 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.072619 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.072944 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.073296 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.073616 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.073958 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.074234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.074542 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.074852 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.075161 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.075472 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.075782 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.076105 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.076452 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.076777 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.077088 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.077410 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.077814 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.078067 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.078378 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.078723 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.078890 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:51:58.079342 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.079483 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:51:58.079610 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.079732 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.079858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:51:58.079989 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.080211 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:51:58.080374 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.080528 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:51:58.080655 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.080859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081006 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081172 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081295 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081494 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081623 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.081812 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082000 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082157 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082302 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082451 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082593 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082742 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.082900 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083051 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083193 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083342 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083483 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083636 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083812 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.083957 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.084099 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.084272 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-2-iscsi {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.084532 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.084678 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.084917 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085184 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085332 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085483 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085625 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085778 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.085933 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086219 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086368 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086510 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086664 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.086825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087150 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087310 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087507 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087661 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087810 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.087952 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.088095 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.088310 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.088476 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089167 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089331 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089475 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089632 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089774 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.089774 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090064 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090064 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090340 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090340 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090609 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.090775 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091124 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091278 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091426 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-2-iscsi {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091666 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091813 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.091970 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092175 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092175 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092465 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092465 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092745 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.092886 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093104 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093250 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093412 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093571 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093722 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.093875 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094024 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094165 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094306 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094456 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094706 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.094850 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095009 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095151 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095308 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095458 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095601 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095741 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.095897 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096047 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096244 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096401 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096547 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096688 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096838 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.096990 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097143 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097285 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097442 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097586 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097727 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.097877 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098026 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098169 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098310 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098462 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098632 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098784 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098928 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.098928 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.099255 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.099404 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.099548 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.099701 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.099855 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.099996 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.100165 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.100322 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.100479 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.100626 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.100779 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.100925 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.101275 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.101434 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.101589 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.101735 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.101877 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.102031 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.102031 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.102339 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.102497 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.102647 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.102803 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.102970 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.103141 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.103300 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.103447 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.103593 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.103739 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.103894 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.103894 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.104219 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.104400 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.105155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.105316 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.105472 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.105620 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.105780 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.105936 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.105936 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.106222 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.106378 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.106526 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.106680 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.106827 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.106974 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.107120 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.107120 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.107411 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.107559 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.107717 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.107865 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.108012 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.108210 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.108370 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.108514 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.108667 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.108810 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.108953 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.109103 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.109254 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.109403 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.109545 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.109692 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.109834 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.109975 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.110127 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.110275 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.110432 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.110642 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.111667 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.111832 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.111976 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.112126 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.112315 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.112484 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.112644 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.112799 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.112948 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.113092 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.113234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.113384 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.113526 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.113677 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.113819 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.113960 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.114101 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.114252 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.114252 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.114549 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.114698 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.114839 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.114981 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.115138 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.115375 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.115530 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.115673 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.115815 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.115958 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.116099 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.116289 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.116441 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.116593 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.116753 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.116904 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.117053 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.117195 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.117345 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.117497 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.117734 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.117888 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.118031 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.118173 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.118323 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.118472 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.118616 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.118771 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.118915 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.119058 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.119209 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.119352 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.119495 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.119638 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.119778 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.119929 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.120080 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.120307 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.120459 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.120615 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.120765 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.120918 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.121060 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.121203 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.121345 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.121720 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.121871 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.122023 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.122165 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.122165 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.122440 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.122619 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.122773 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.122931 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.123074 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.123215 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.123366 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.123511 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.123662 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.123814 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.123957 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.124097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.124256 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.124422 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.124579 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.124722 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.124864 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.125014 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.125167 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.125321 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.125584 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.125730 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.125875 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.126027 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.126175 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:51:58.126317 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.126477 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.126621 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.126762 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.126909 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127086 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127243 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127387 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127527 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127676 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127820 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.127971 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128123 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128313 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128467 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128611 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128753 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.128915 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129072 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129216 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129357 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129499 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129650 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129790 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.129941 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130092 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130243 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130386 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130527 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130677 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130819 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.130960 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.131102 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.131102 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.131373 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.131529 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.131688 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132022 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132192 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132347 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132490 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132667 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132836 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.132980 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133309 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133460 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133616 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133759 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.133901 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134064 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134208 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134365 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134509 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134658 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134812 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.134955 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.135096 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.135251 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.135395 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.136056 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.136412 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.136566 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.136712 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.136874 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137019 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137163 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137398 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137558 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137703 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.137861 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138005 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138148 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138292 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138292 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138577 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138721 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.138874 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139035 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139269 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139427 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139591 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139738 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.139885 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140030 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140213 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140213 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140505 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140648 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140797 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.140944 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141086 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141227 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141383 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141525 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141674 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.141816 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142159 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142316 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142469 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142615 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142761 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.142938 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143095 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143254 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143403 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143545 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143696 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143838 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.143979 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.144245 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.144399 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.144591 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.144749 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.144955 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145119 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145283 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145432 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145586 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145734 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.145881 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146028 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146182 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146337 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146598 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146754 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.146903 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147066 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147228 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147376 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147530 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147677 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147824 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.147984 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148163 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148317 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148459 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148603 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148758 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.148911 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149083 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149377 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149519 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149661 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149813 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.149965 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150108 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150249 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150391 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150563 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150709 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.150852 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.151003 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.151247 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.151908 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.152433 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.152601 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.152746 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.152889 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153061 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153222 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153377 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153534 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153684 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153834 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.153987 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154138 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154290 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154434 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154601 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154601 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154881 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.154881 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155161 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155306 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155447 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155588 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155730 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.155892 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.156057 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.156296 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.156447 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.156620 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.156847 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157005 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157159 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157302 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157453 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157597 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157747 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.157747 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158044 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158188 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158332 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158482 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158633 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158777 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.158918 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159060 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159221 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159382 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159722 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.159864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160012 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160185 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160350 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160508 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160654 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160806 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.160957 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161101 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161252 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161405 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161405 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161721 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.161867 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162026 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162180 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162324 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162660 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162816 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.162962 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163121 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163312 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163464 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163614 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163764 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.163912 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164061 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164061 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164437 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164581 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164581 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.164868 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165012 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165168 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165313 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165455 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165598 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165742 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.165885 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.166043 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.166219 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.166381 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.166531 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167056 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167202 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167356 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167510 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167661 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167806 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.167950 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168102 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168289 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168588 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168732 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.168877 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169021 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169176 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169345 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169492 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169639 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169793 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.169942 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170244 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170397 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170544 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170690 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170837 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.170994 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171148 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171295 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171448 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171595 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171595 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.171963 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.172114 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.172287 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.172448 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.172609 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.172988 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173164 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173333 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173511 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173682 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173826 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.173980 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174125 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174267 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174267 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174556 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174556 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174841 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.174985 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175137 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175325 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175468 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175621 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175764 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.175913 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176057 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176229 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176376 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176376 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176679 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.176978 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.177248 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.177398 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.177561 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.177718 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.177863 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178008 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178150 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178304 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178457 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178608 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178753 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.178904 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179047 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179202 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179360 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179528 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179675 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179822 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.179970 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180127 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180358 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180513 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180668 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180813 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.180954 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181106 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181256 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181401 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181544 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181686 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181827 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.181978 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.182127 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.182271 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.182446 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.182592 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.182734 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183099 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183257 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183437 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183611 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183765 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.183920 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184064 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184230 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184378 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184534 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184686 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.184840 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185066 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185292 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185463 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185612 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185760 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.185922 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186070 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186216 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186371 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186521 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186843 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.186992 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.187139 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.187397 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.187549 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.187707 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.187855 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188002 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188184 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188339 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188484 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188640 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188787 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.188937 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189251 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189409 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189577 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189725 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.189874 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190022 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190176 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190428 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190586 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190735 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.190897 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191046 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191194 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191356 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191356 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191645 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191800 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.191949 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192096 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192280 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192424 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192567 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192716 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.192868 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.193038 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.193383 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.193539 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.193716 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.193862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194006 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194148 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194289 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194446 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194591 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194743 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.194887 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195037 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195181 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195333 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195485 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195673 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195826 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.195978 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196131 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196395 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196556 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196702 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196846 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.196989 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.197156 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.197301 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.197569 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.197723 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.197869 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.198516 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.198674 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.198820 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.198976 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199123 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199275 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199430 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199671 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199828 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.199977 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200124 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200308 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200480 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200641 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200785 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.200927 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201069 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201211 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201211 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201499 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201650 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201802 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.201946 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202249 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202402 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202402 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202673 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202817 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.202960 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.203115 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.203475 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.203628 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.203790 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.203951 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204108 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204277 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204425 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204571 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204715 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.204858 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205021 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205182 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205331 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205479 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205628 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205781 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.205939 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206087 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206235 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206381 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206535 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206685 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206844 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.206994 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.207141 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.207289 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.207443 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.207821 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.207974 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208122 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208294 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208448 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208604 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208760 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208903 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.208903 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209195 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209338 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209481 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209650 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209802 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.209953 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210240 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210382 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210543 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210687 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210832 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.210975 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211117 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211277 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211420 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211569 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211719 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.211719 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.212002 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.212265 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.212424 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.212571 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.212839 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.213001 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.213192 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.213374 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.213758 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.214420 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.214585 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.214741 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.214901 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215193 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215346 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215494 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215642 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215791 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.215948 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216105 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216285 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216431 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216725 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.216884 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217040 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217193 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217336 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217479 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217622 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.217790 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218034 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218189 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218333 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218333 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218606 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218763 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.218907 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219238 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219383 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219535 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219705 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.219882 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220046 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220232 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220232 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220523 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220668 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220818 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.220963 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221115 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221261 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221417 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221579 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221737 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.221882 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222025 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222170 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222325 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222470 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222616 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.222913 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.223066 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.223210 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.223357 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.223524 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.223883 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224034 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224034 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224426 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224600 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224763 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.224914 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225059 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225230 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225455 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225601 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225744 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.225886 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226028 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226185 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226327 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226470 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226612 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226755 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.226917 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227063 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227205 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227349 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227492 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227644 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227798 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.227950 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.228239 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.228389 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.228545 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.228692 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.228847 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229012 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229158 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229325 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229470 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229624 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.229853 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230014 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230164 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230421 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230611 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230764 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.230927 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231083 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231248 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231404 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231404 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231696 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.231853 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232002 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232178 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232335 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232509 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232663 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232809 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.232962 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233107 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233265 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233410 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233553 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233703 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.233877 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.234140 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.234286 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.234429 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.234581 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.234769 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.235127 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.235274 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.235440 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.235701 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.235855 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236008 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236198 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236352 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236498 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236498 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236788 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.236948 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237099 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237244 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237428 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237581 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237737 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.237891 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238039 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238206 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238457 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238605 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238751 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.238911 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239059 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239203 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239356 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239518 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239518 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239826 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.239972 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.240220 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.240369 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.240526 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.240748 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.240902 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241045 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241189 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241458 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241608 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241768 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.241914 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242087 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242244 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242388 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242531 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242684 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242836 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.242989 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243132 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243281 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243435 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243588 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243751 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.243751 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244028 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244028 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244473 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244620 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244766 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.244953 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245131 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245276 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245432 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245578 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245736 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.245981 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246127 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246273 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246428 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246573 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246718 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.246869 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247027 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247179 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247333 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247479 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247623 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.247767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.248121 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.248314 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.248476 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.248476 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.248862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249009 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249154 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249308 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249453 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249599 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249743 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.249889 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250048 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250216 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250373 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250522 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250671 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250819 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.250972 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251133 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251281 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251428 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251575 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251726 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.251883 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252052 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252223 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252385 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252543 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252690 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.252940 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253087 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253246 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253410 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253555 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253711 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.253865 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254015 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254157 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254309 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254468 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254712 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.254859 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255007 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255175 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255332 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255475 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255629 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255629 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.255920 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.256246 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.256407 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.256562 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.256708 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.256860 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257006 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257307 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257464 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257609 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257753 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.257898 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258056 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258203 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258356 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258509 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258655 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.258894 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259042 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259208 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259401 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259565 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259713 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.259862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.260017 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.260214 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.260380 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261038 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261189 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261337 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261485 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261643 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261791 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.261791 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262079 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262235 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262383 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262545 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262695 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262844 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.262991 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263146 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263305 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263467 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263626 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263775 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.263922 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264082 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264290 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264437 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264586 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.264978 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265123 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265295 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265460 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265610 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.265892 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266042 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266208 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266433 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266585 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266729 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.266873 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267027 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267172 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267316 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267460 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267607 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267607 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.267889 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268034 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268230 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268380 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268540 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268696 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.268866 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269098 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269247 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269401 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269551 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269695 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269853 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.269998 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.270143 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.270326 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.270482 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.270728 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.270882 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271032 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271181 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271330 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271478 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271642 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271793 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.271793 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272082 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272331 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272478 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272643 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272790 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.272934 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273221 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273366 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273538 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273700 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273846 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.273998 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274141 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274294 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274446 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274595 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274740 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.274740 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275032 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275365 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275542 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275688 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275840 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.275983 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.276200 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.276868 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277128 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277280 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277446 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277595 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277743 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.277905 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278055 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278203 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278351 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278499 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278655 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278803 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.278952 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.279114 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.279368 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.279553 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.279748 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.279904 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280053 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280271 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280416 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280577 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280737 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.280882 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281025 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281167 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281316 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281476 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281621 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281763 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.281913 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282062 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282204 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282359 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282504 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282647 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282797 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.282797 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283069 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283235 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283378 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283529 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283680 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283823 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.283977 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284121 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284319 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284465 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284618 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284774 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284933 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.284933 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.285225 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.285605 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.285794 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.285956 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286115 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286266 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286413 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286562 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286710 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.286868 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287017 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287275 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287436 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287585 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287732 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.287889 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288037 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288208 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288208 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288487 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288631 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288786 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.288929 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289080 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289235 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289400 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289641 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289800 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.289944 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290086 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290236 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290386 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290557 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290730 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.290883 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.291028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.291170 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.291319 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.291472 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.291884 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292029 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292218 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292366 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292511 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292667 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292820 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.292964 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293109 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293252 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293406 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293556 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293710 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.293860 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294006 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294148 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294148 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294433 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294433 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294723 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.294865 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295008 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295160 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295308 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295467 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295714 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.295877 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296043 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296226 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296379 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296527 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296675 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296834 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.296992 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297141 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297311 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297548 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297699 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297856 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.297856 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298154 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298309 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298459 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298608 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298756 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.298943 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.299139 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.299299 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.299455 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.299455 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.299857 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300011 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300223 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300383 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300528 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300686 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.300920 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301075 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301220 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301364 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301364 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301651 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301805 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.301957 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302136 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302336 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302490 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302642 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302795 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.302939 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303083 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303227 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303379 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303532 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303682 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303833 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.303976 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304134 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304325 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304488 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304635 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304787 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.304932 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305076 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305246 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305404 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305555 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305716 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.305971 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306141 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306287 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306441 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306587 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306739 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.306885 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307038 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307235 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307437 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307603 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307847 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.307998 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308179 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308341 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308486 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308628 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308772 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.308922 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309066 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309217 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309217 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309504 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309647 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.309796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310057 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310210 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310387 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310542 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310684 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310837 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.310991 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311135 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311276 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311426 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311568 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311717 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.311869 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.312013 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.312776 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.312938 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313069 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313200 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313356 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313511 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313675 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313815 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.313955 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314115 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314272 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314446 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314614 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314766 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.314917 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315074 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315229 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315380 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315543 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315699 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.315897 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.316235 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.316399 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.316562 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.316730 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.316898 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.317082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.317262 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.317428 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.317597 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.317764 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318090 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318278 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318452 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318623 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318794 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.318966 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.319136 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.319325 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.319497 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.320429 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.320580 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.320726 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.320914 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321071 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321216 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321366 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321518 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321672 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321824 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.321970 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322122 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322269 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322411 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322562 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322727 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322921 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.322921 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.323721 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.323872 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324227 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324386 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324532 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324676 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324850 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.324850 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.325144 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.326360 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.327444 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.328752 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.329859 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.331028 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.332187 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.333282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334243 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334243 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334243 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334653 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334653 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.334940 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.335240 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.335552 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.335867 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.336202 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.336535 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.337037 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.337201 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.337476 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.337800 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.338150 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.338474 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.339562 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.339889 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.340241 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.340562 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.340863 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:51:58.341106 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:51:58.473277 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO dbcounter [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Registered counter for database nova_api Sep 08 13:51:58.498378 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.502289 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO dbcounter [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Registered counter for database nova_api Sep 08 13:51:58.509491 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writer thread running {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.523804 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.531142 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writer thread running {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.583217 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.context [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ddabd24-226a-4d6c-890f-c80b419c7ead(cell1) {{(pid=112879) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:51:58.587648 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:58.588130 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:58.589862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:58.590644 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:58.591097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:58.593247 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_concurrency.lockutils [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:58.595405 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO dbcounter [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Registered counter for database nova_cell0 Sep 08 13:51:58.596281 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.context [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ddabd24-226a-4d6c-890f-c80b419c7ead(cell1) {{(pid=112880) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 13:51:58.599893 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO dbcounter [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Registered counter for database nova_cell1 Sep 08 13:51:58.600736 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:58.601328 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:58.603368 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:58.604626 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:58.605313 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:58.608926 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:58.609455 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.611977 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO dbcounter [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Registered counter for database nova_cell0 Sep 08 13:51:58.612383 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.617577 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO dbcounter [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Registered counter for database nova_cell1 Sep 08 13:51:58.618513 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writer thread running {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.627063 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writer thread running {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.627482 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.630654 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.635180 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writer thread running {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.778403 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO dbcounter [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Registered counter for database nova_cell0 Sep 08 13:51:58.782813 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writer thread running {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.786041 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.792916 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writer thread running {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:58.796646 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO dbcounter [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Registered counter for database nova_cell0 Sep 08 13:51:58.809157 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:51:58.815056 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writer thread running {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:51:59.438539 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: WARNING keystonemiddleware.auth_token [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:59.446418 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: WARNING keystonemiddleware.auth_token [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:59.484265 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: WARNING keystonemiddleware.auth_token [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:59.491751 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: WARNING keystonemiddleware.auth_token [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:59.800349 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: WARNING keystonemiddleware.auth_token [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:59.806696 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: WARNING keystonemiddleware.auth_token [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:59.812170 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562fcf009c0 pid: 112880 (default app) Sep 08 13:51:59.814519 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:59.815735 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] 10.222.0.97 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001966 Sep 08 13:51:59.816195 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 1/1] 10.222.0.97 () {50 vars in 788 bytes} [Thu Sep 8 13:51:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:59.852176 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: WARNING keystonemiddleware.auth_token [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 13:51:59.858680 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: WARNING keystonemiddleware.auth_token [None req-1f6e4046-7bb1-4bf7-b4b3-69ec9aba83e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 13:51:59.864268 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562fcf009c0 pid: 112879 (default app) Sep 08 13:53:41.244635 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:41.247793 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003630 Sep 08 13:53:41.248652 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 2/2] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:41.263097 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_api:SELECT=3 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:41.264752 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_cell0:SELECT=3 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:41.265829 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_cell1:SELECT=3 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:41.266830 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:42.760987 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-86c7375e-8986-4d1d-a93b-8def9a03223f admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:42.818644 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-86c7375e-8986-4d1d-a93b-8def9a03223f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.561821 Sep 08 13:53:42.821704 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 1/3] 10.222.0.97 () {60 vars in 1292 bytes} [Thu Sep 8 13:53:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:45.945716 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:45.946735 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2a6cd594-fafb-4fab-a95f-679ea080daf9 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 08 13:53:45.947158 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 3/4] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:46.530846 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-c4290543-18f4-4ae6-a2f0-f15a781f0458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:46.686603 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-c4290543-18f4-4ae6-a2f0-f15a781f0458 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.731755 Sep 08 13:53:46.687602 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 2/5] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:53:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:46.703074 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:SELECT=3 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:46.705464 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_cell1:SELECT=3 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:46.706535 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_cell0:SELECT=3 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:46.707284 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:46.975651 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-1a064b28-d34e-49c7-b0e4-6fa8db16091e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:47.200704 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-1a064b28-d34e-49c7-b0e4-6fa8db16091e admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.503162 Sep 08 13:53:47.201922 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 4/6] 10.222.0.97 () {64 vars in 1336 bytes} [Thu Sep 8 13:53:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:50.272881 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-c4290543-18f4-4ae6-a2f0-f15a781f0458 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:50.274916 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-c4290543-18f4-4ae6-a2f0-f15a781f0458 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002813 Sep 08 13:53:50.276484 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 3/7] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:51.055227 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-748eab8c-355d-41a9-be73-d23443a3b55a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "swap": 0, "id": "d1", "ram": 512}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:51.274083 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-748eab8c-355d-41a9-be73-d23443a3b55a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.985688 Sep 08 13:53:51.276698 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 5/8] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:53:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:51.302530 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-a044cf2b-a5db-4f4c-ba2b-4bceb55cc345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:51.502398 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-a044cf2b-a5db-4f4c-ba2b-4bceb55cc345 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.211891 Sep 08 13:53:51.503432 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 4/9] 10.222.0.97 () {64 vars in 1336 bytes} [Thu Sep 8 13:53:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:54.478750 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-748eab8c-355d-41a9-be73-d23443a3b55a admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:54.480910 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-748eab8c-355d-41a9-be73-d23443a3b55a admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002795 Sep 08 13:53:54.481514 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 6/10] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:55.097595 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-4b84ba2d-6e9c-4df3-abff-ff44add2105b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "swap": 0}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:55.231019 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-4b84ba2d-6e9c-4df3-abff-ff44add2105b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.740492 Sep 08 13:53:55.232123 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 5/11] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:53:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:53:55.245569 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-1dd6abd4-e04e-4e14-8b3b-6a094eeb945a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:55.386517 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-1dd6abd4-e04e-4e14-8b3b-6a094eeb945a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144876 Sep 08 13:53:55.387125 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 7/12] 10.222.0.97 () {64 vars in 1336 bytes} [Thu Sep 8 13:53:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:58.705356 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-4b84ba2d-6e9c-4df3-abff-ff44add2105b admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:58.707023 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-4b84ba2d-6e9c-4df3-abff-ff44add2105b admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Sep 08 13:53:58.712755 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 6/13] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:53:58 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:53:59.387079 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-bd751611-0294-4615-a533-3be882c95797 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:59.630689 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-bd751611-0294-4615-a533-3be882c95797 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.914596 Sep 08 13:53:59.631589 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 8/14] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:53:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:53:59.647335 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-9d6e8f62-2788-44d1-8315-99816803eae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:59.808790 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-9d6e8f62-2788-44d1-8315-99816803eae8 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164624 Sep 08 13:53:59.810856 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 7/15] 10.222.0.97 () {64 vars in 1336 bytes} [Thu Sep 8 13:53:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:03.288754 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-bd751611-0294-4615-a533-3be882c95797 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:03.289831 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-bd751611-0294-4615-a533-3be882c95797 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Sep 08 13:54:03.290238 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 9/16] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:03.892698 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:04.004003 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705372 Sep 08 13:54:04.004620 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 8/17] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:54:04.018816 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ad87ac75-5799-42b1-8241-17059c13c922 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:04.218236 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ad87ac75-5799-42b1-8241-17059c13c922 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.202873 Sep 08 13:54:04.219369 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 10/18] 10.222.0.97 () {64 vars in 1336 bytes} [Thu Sep 8 13:54:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:07.797326 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:07.798589 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Sep 08 13:54:07.799088 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 9/19] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:08.407034 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2cc68c49-8676-4afb-87ab-8da1474e0291 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:08.438758 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2cc68c49-8676-4afb-87ab-8da1474e0291 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.631736 Sep 08 13:54:08.443441 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 11/20] 10.222.0.97 () {60 vars in 1292 bytes} [Thu Sep 8 13:54:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:11.736960 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:11.738586 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-60826256-5623-4d69-b6ab-801eb444990f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Sep 08 13:54:11.739251 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 10/21] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:12.306905 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2ba8b760-7bc9-496e-9c8a-3ea34117b116 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "swap": 0}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:12.451563 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2ba8b760-7bc9-496e-9c8a-3ea34117b116 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.703999 Sep 08 13:54:12.452302 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 12/22] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:54:12.469077 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-579f5270-a327-4122-b1d0-8b0c1888eb79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:12.477177 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.638646 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-579f5270-a327-4122-b1d0-8b0c1888eb79 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.174775 Sep 08 13:54:12.639238 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 11/23] 10.222.0.97 () {64 vars in 1333 bytes} [Thu Sep 8 13:54:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:15.913755 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2ba8b760-7bc9-496e-9c8a-3ea34117b116 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:15.915529 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2ba8b760-7bc9-496e-9c8a-3ea34117b116 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002270 Sep 08 13:54:15.916126 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 13/24] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:16.720368 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-10442778-bfef-463b-9f64-9e33520abfc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:16.838682 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-10442778-bfef-463b-9f64-9e33520abfc0 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.912481 Sep 08 13:54:16.839410 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 12/25] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:16.863356 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2b70aedb-194a-4d5d-920a-27f24efa1f7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:16.992982 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2b70aedb-194a-4d5d-920a-27f24efa1f7b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138238 Sep 08 13:54:16.996358 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 14/26] 10.222.0.97 () {64 vars in 1333 bytes} [Thu Sep 8 13:54:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:20.305105 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-10442778-bfef-463b-9f64-9e33520abfc0 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.306940 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-10442778-bfef-463b-9f64-9e33520abfc0 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 Sep 08 13:54:20.308772 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 13/27] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:21.016391 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ef0ee17c-b390-40d2-8ac6-4243e056e135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:21.027138 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:21.160262 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ef0ee17c-b390-40d2-8ac6-4243e056e135 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.840857 Sep 08 13:54:21.160869 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 15/28] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:21.183373 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-6c6e3542-54a5-4814-908e-46e86f2d8b44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:21.322476 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-6c6e3542-54a5-4814-908e-46e86f2d8b44 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146051 Sep 08 13:54:21.325315 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 14/29] 10.222.0.97 () {64 vars in 1333 bytes} [Thu Sep 8 13:54:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:25.083432 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ef0ee17c-b390-40d2-8ac6-4243e056e135 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.086740 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ef0ee17c-b390-40d2-8ac6-4243e056e135 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003792 Sep 08 13:54:25.087228 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 16/30] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:25.843804 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ecff534a-0050-46c4-a7fd-f64403964bd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:26.034145 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ecff534a-0050-46c4-a7fd-f64403964bd5 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.938602 Sep 08 13:54:26.036205 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 15/31] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:54:26.054523 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-a3819e13-8c1a-4833-b0e0-7970b0c7ef7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:26.300879 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-a3819e13-8c1a-4833-b0e0-7970b0c7ef7a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.255237 Sep 08 13:54:26.332621 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 17/32] 10.222.0.97 () {64 vars in 1333 bytes} [Thu Sep 8 13:54:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:29.301973 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ecff534a-0050-46c4-a7fd-f64403964bd5 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.303759 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ecff534a-0050-46c4-a7fd-f64403964bd5 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Sep 08 13:54:29.304202 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 16/33] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:29.924831 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:30.123160 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.811217 Sep 08 13:54:30.124181 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 18/34] 10.222.0.97 () {64 vars in 1283 bytes} [Thu Sep 8 13:54:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:30.146900 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f537178e-1f3a-4e5c-a312-bded3fb91033 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:30.319282 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f537178e-1f3a-4e5c-a312-bded3fb91033 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.178319 Sep 08 13:54:30.321189 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 17/35] 10.222.0.97 () {64 vars in 1333 bytes} [Thu Sep 8 13:54:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:44.701719 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:44.702904 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001777 Sep 08 13:54:44.703373 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 19/36] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:44.715773 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:45.210520 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-71221d22-1575-4523-b6dd-ccfd338aaa96 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:45.245623 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-71221d22-1575-4523-b6dd-ccfd338aaa96 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.534622 Sep 08 13:54:45.246659 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 18/37] 10.222.0.97 () {60 vars in 1292 bytes} [Thu Sep 8 13:54:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:46.661074 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:46.662084 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-aef5d47e-373a-430c-9d47-cab4fb7b60ed admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 08 13:54:46.662496 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 20/38] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:47.273307 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-93a12939-e70b-47ec-a5bf-17ce88baa912 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.282275 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.wsgi [None req-93a12939-e70b-47ec-a5bf-17ce88baa912 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-93a12939-e70b-47ec-a5bf-17ce88baa912 admin admin] Request method failure captured: Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept: application/json Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept-Encoding: gzip, deflate Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Connection: keep-alive Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Content-Length: 0 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Host: 10.222.0.97 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-System-Scope: None Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: User-Agent: python-novaclient Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Auth-Token: gAAAAABjGfQminWYCxgQ36KNL3wxxEz07o8DjUGLplWNiqq5BTXPiZNwmgOJLJ6zEBWVy-goaZWVkabMY5mO3eDmT3yObzYmC5TUDwoC5M303RPuUIztQF4czMVtZ6H8KLmWedlYmu1JOXuGoha3KUt4Du9EjyjHJkj2gOV4ektAiwmsQV0FOEY Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Id: None Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Name: None Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Identity-Status: Confirmed Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Is-Admin-Project: True Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Id: default Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Name: Default Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Name: admin Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Role: reader,member,admin Sep 08 13:54:47.288055 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Roles: reader,member,admin Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant: admin Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Name: admin Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User: admin Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Id: default Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Name: Default Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Name: admin Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: method: > Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: exception: Flavor 42 could not be found. Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: action_args: {'id': '42'} Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:47.289715 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:47.290567 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.291825 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-93a12939-e70b-47ec-a5bf-17ce88baa912 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:47.292930 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-93a12939-e70b-47ec-a5bf-17ce88baa912 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.472683 Sep 08 13:54:47.292930 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 19/39] 10.222.0.97 () {60 vars in 1190 bytes} [Thu Sep 8 13:54:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:47.305754 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-0082db23-ec1f-4235-a539-d17c34dfedad admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.312466 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:47.341310 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-0082db23-ec1f-4235-a539-d17c34dfedad admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.042010 Sep 08 13:54:47.341909 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 21/40] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:47.353804 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-6886af36-df19-452a-b8f6-ce4b1580a614 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.377532 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-6886af36-df19-452a-b8f6-ce4b1580a614 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028621 Sep 08 13:54:47.378043 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 20/41] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:47.389087 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ab34ff3a-34d2-445c-b833-b314d093136b admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.394792 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.wsgi [None req-ab34ff3a-34d2-445c-b833-b314d093136b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ab34ff3a-34d2-445c-b833-b314d093136b admin admin] Request method failure captured: Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept: application/json Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept-Encoding: gzip, deflate Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Connection: keep-alive Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Content-Length: 0 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Host: 10.222.0.97 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-System-Scope: None Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: User-Agent: python-novaclient Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Auth-Token: gAAAAABjGfQminWYCxgQ36KNL3wxxEz07o8DjUGLplWNiqq5BTXPiZNwmgOJLJ6zEBWVy-goaZWVkabMY5mO3eDmT3yObzYmC5TUDwoC5M303RPuUIztQF4czMVtZ6H8KLmWedlYmu1JOXuGoha3KUt4Du9EjyjHJkj2gOV4ektAiwmsQV0FOEY Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Id: None Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Name: None Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Identity-Status: Confirmed Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Is-Admin-Project: True Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Id: default Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Name: Default Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Name: admin Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Role: reader,member,admin Sep 08 13:54:47.398155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Roles: reader,member,admin Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant: admin Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Name: admin Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User: admin Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Id: default Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Name: Default Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Name: admin Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: method: > Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: exception: Flavor 42 could not be found. Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: action_args: {'id': '42'} Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:47.399858 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:47.403282 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:47.404681 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ab34ff3a-34d2-445c-b833-b314d093136b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:47.405908 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ab34ff3a-34d2-445c-b833-b314d093136b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015177 Sep 08 13:54:47.405908 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 22/42] 10.222.0.97 () {60 vars in 1190 bytes} [Thu Sep 8 13:54:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:48.692416 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-6886af36-df19-452a-b8f6-ce4b1580a614 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:48.693501 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-6886af36-df19-452a-b8f6-ce4b1580a614 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 08 13:54:48.693909 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 21/43] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:49.261824 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-068f3118-ef14-4a09-8ecb-51d333b40013 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.267193 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.wsgi [None req-068f3118-ef14-4a09-8ecb-51d333b40013 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-068f3118-ef14-4a09-8ecb-51d333b40013 admin admin] Request method failure captured: Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept: application/json Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept-Encoding: gzip, deflate Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Connection: keep-alive Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Content-Length: 0 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Host: 10.222.0.97 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-System-Scope: None Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: User-Agent: python-novaclient Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Auth-Token: gAAAAABjGfQorI6v0KMzVO9hpy-Ob5C8Xn93-yRK_N2vpeJCciyPDO49pRYlkQJ3xwZ-_nbHUBIwZTXPbY6Ypm3aR77aVmIPiSQiJXYI-HQRuUdb6vLVgH4wdNT5OoKUgymRdrmr4dZ8LMatf-YURXzpRnszjdaZKZyaNst4dIdPxWotfNjkkhg Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Id: None Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Name: None Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Identity-Status: Confirmed Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Is-Admin-Project: True Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Id: default Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Name: Default Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Name: admin Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Role: reader,member,admin Sep 08 13:54:49.268796 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Roles: reader,member,admin Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant: admin Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Name: admin Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User: admin Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Id: default Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Name: Default Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Name: admin Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: method: > Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: exception: Flavor 84 could not be found. Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: action_args: {'id': '84'} Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:49.270370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:49.271409 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.272911 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-068f3118-ef14-4a09-8ecb-51d333b40013 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:49.274220 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-068f3118-ef14-4a09-8ecb-51d333b40013 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.434718 Sep 08 13:54:49.274220 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 23/44] 10.222.0.97 () {60 vars in 1190 bytes} [Thu Sep 8 13:54:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:49.282891 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-4196647f-5efd-43bf-acae-8f5b7df54ddd admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.298400 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-4196647f-5efd-43bf-acae-8f5b7df54ddd admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019323 Sep 08 13:54:49.298962 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 22/45] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:49.310197 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ac882bdf-ed37-4740-b66d-dce3ddcc7928 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.334866 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ac882bdf-ed37-4740-b66d-dce3ddcc7928 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029127 Sep 08 13:54:49.335948 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 24/46] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:49.345813 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-747b3218-3402-4ba1-9993-a4bf7dd7294d admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.350989 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.wsgi [None req-747b3218-3402-4ba1-9993-a4bf7dd7294d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-747b3218-3402-4ba1-9993-a4bf7dd7294d admin admin] Request method failure captured: Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept: application/json Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept-Encoding: gzip, deflate Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Connection: keep-alive Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Content-Length: 0 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Host: 10.222.0.97 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-System-Scope: None Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: User-Agent: python-novaclient Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Auth-Token: gAAAAABjGfQorI6v0KMzVO9hpy-Ob5C8Xn93-yRK_N2vpeJCciyPDO49pRYlkQJ3xwZ-_nbHUBIwZTXPbY6Ypm3aR77aVmIPiSQiJXYI-HQRuUdb6vLVgH4wdNT5OoKUgymRdrmr4dZ8LMatf-YURXzpRnszjdaZKZyaNst4dIdPxWotfNjkkhg Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Id: None Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Name: None Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Identity-Status: Confirmed Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Is-Admin-Project: True Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Id: default Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Name: Default Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Name: admin Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Role: reader,member,admin Sep 08 13:54:49.352574 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Roles: reader,member,admin Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant: admin Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Name: admin Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User: admin Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Id: default Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Name: Default Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Name: admin Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: method: > Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: exception: Flavor 84 could not be found. Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: action_args: {'id': '84'} Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:49.354082 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:49.354862 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:49.356234 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-747b3218-3402-4ba1-9993-a4bf7dd7294d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:49.357267 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-747b3218-3402-4ba1-9993-a4bf7dd7294d admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011876 Sep 08 13:54:49.357267 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 23/47] 10.222.0.97 () {60 vars in 1190 bytes} [Thu Sep 8 13:54:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:50.640631 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-ac882bdf-ed37-4740-b66d-dce3ddcc7928 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:50.642416 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-ac882bdf-ed37-4740-b66d-dce3ddcc7928 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002795 Sep 08 13:54:50.643166 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 25/48] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:51.259341 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-0e1aed11-e699-466d-bd0c-f66d17b70974 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:51.269409 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.wsgi [None req-0e1aed11-e699-466d-bd0c-f66d17b70974 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-0e1aed11-e699-466d-bd0c-f66d17b70974 admin admin] Request method failure captured: Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept: application/json Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Accept-Encoding: gzip, deflate Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Connection: keep-alive Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Content-Length: 0 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Host: 10.222.0.97 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Openstack-System-Scope: None Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: User-Agent: python-novaclient Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Auth-Token: gAAAAABjGfQqKzZklqKvVh0jrNofuMKa1F0CrAmpjIddy6K9VgYvyrkBM_38mRI5G4EHmYWryrA_lM6Rrz1ls2K9QXc79-1oP3rUO7dTnFVGw6PWH2_ib2-hRGnlsU010FKj8Roiz4Mrm_KyG5x8HJBUMEAloJXvR0HwJB0tz6apbtOGaX5HZCs Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Id: None Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Domain-Name: None Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Identity-Status: Confirmed Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Is-Admin-Project: True Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Id: default Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Domain-Name: Default Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Project-Name: admin Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Role: reader,member,admin Sep 08 13:54:51.271004 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Roles: reader,member,admin Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant: admin Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-Tenant-Name: admin Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User: admin Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Id: default Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Domain-Name: Default Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: X-User-Name: admin Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: method: > Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: exception: Flavor 451 could not be found. Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: action_args: {'id': '451'} Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:51.272902 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:51.273767 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.274864 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-0e1aed11-e699-466d-bd0c-f66d17b70974 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:51.275856 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-0e1aed11-e699-466d-bd0c-f66d17b70974 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.487895 Sep 08 13:54:51.275856 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 24/49] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:54:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:51.283606 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-2d00f5be-208c-432f-ac2a-0e958f11a00b admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:51.301142 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-2d00f5be-208c-432f-ac2a-0e958f11a00b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021540 Sep 08 13:54:51.301723 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 26/50] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:54:51.312533 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:51.329321 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020466 Sep 08 13:54:51.329977 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 25/51] 10.222.0.97 () {60 vars in 1210 bytes} [Thu Sep 8 13:54:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:54:51.340333 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-be9f759e-fa13-477b-a171-eb37b721c74b admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:51.346036 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.wsgi [None req-be9f759e-fa13-477b-a171-eb37b721c74b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-be9f759e-fa13-477b-a171-eb37b721c74b admin admin] Request method failure captured: Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept: application/json Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Accept-Encoding: gzip, deflate Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Connection: keep-alive Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Content-Length: 0 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Host: 10.222.0.97 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-Api-Version: compute 2.92 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Openstack-System-Scope: None Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: User-Agent: python-novaclient Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Auth-Token: gAAAAABjGfQqKzZklqKvVh0jrNofuMKa1F0CrAmpjIddy6K9VgYvyrkBM_38mRI5G4EHmYWryrA_lM6Rrz1ls2K9QXc79-1oP3rUO7dTnFVGw6PWH2_ib2-hRGnlsU010FKj8Roiz4Mrm_KyG5x8HJBUMEAloJXvR0HwJB0tz6apbtOGaX5HZCs Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Id: None Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Domain-Name: None Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Identity-Status: Confirmed Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Is-Admin-Project: True Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Id: default Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Domain-Name: Default Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Project-Name: admin Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Role: reader,member,admin Sep 08 13:54:51.348590 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Roles: reader,member,admin Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/5225debdf3f04c89923ec01541ea8b94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_5225debdf3f04c89923ec01541ea8b94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant: admin Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Id: 5225debdf3f04c89923ec01541ea8b94 Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-Tenant-Name: admin Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User: admin Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Id: default Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Domain-Name: Default Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Id: d6d84dfa12274652b8eb04c682b6e60e Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: X-User-Name: admin Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: method: > Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: exception: Flavor 451 could not be found. Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: action_args: {'id': '451'} Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:54:51.350130 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:51.351078 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: ERROR nova.api.openstack.wsgi Sep 08 13:54:51.352296 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-be9f759e-fa13-477b-a171-eb37b721c74b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:54:51.353589 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-be9f759e-fa13-477b-a171-eb37b721c74b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013988 Sep 08 13:54:51.353589 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 27/52] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:54:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:52.767254 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:52.768310 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 08 13:54:52.768731 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 26/53] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:53.391816 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-bde0a962-f330-4e15-a6b9-443bf648caea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:53.499014 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-bde0a962-f330-4e15-a6b9-443bf648caea admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.586518 Sep 08 13:54:53.499566 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 28/54] 10.222.0.97 () {64 vars in 1235 bytes} [Thu Sep 8 13:54:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:54.836855 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.838220 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Sep 08 13:54:54.839096 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 27/55] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:55.544861 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-54c3ff1c-8e8c-4be0-a47a-142ee7ef455a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:55.644040 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-54c3ff1c-8e8c-4be0-a47a-142ee7ef455a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.660049 Sep 08 13:54:55.644685 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 29/56] 10.222.0.97 () {64 vars in 1235 bytes} [Thu Sep 8 13:54:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:56.963458 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:56.964852 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Sep 08 13:54:56.965284 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 28/57] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:57.561991 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-936d2ba1-35ad-42e3-a952-72c96e552c11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:57.747447 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-936d2ba1-35ad-42e3-a952-72c96e552c11 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.639098 Sep 08 13:54:57.748155 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 30/58] 10.222.0.97 () {64 vars in 1235 bytes} [Thu Sep 8 13:54:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:54:59.065459 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:59.066539 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 08 13:54:59.066946 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 29/59] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:59.684786 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-b3fb2380-e288-4efc-b330-1114f633dc85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:59.787868 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-b3fb2380-e288-4efc-b330-1114f633dc85 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.576012 Sep 08 13:54:59.788632 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 31/60] 10.222.0.97 () {64 vars in 1235 bytes} [Thu Sep 8 13:54:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:55:01.313000 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.313826 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 08 13:55:01.314435 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 30/61] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:01.937356 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-c209e842-120a-4acd-8807-a1153dd2f8d5 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.959830 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-c209e842-120a-4acd-8807-a1153dd2f8d5 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.499182 Sep 08 13:55:01.960431 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 32/62] 10.222.0.97 () {60 vars in 1202 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:56:04.073823 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.074955 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-f74e555e-3482-4a39-9bfc-5dc3b22a84f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 08 13:56:04.075447 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 31/63] 10.222.0.97 () {54 vars in 931 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:04.083660 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:04.680990 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-60f2acdf-ee3d-483f-8beb-ace0e1d598f9 admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.705074 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-60f2acdf-ee3d-483f-8beb-ace0e1d598f9 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.622696 Sep 08 13:56:04.705683 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 33/64] 10.222.0.97 () {60 vars in 1292 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:56:04.728100 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_api:SELECT=14 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:04.732506 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-8b43be5f-c2e8-491e-9b0d-d4e4371f3abd admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.740790 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-8b43be5f-c2e8-491e-9b0d-d4e4371f3abd admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014141 Sep 08 13:56:04.741379 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 32/65] 10.222.0.97 () {60 vars in 1283 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:04.754926 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-6361df92-9ef2-4782-9929-4709e68d058b admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.763885 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-6361df92-9ef2-4782-9929-4709e68d058b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013031 Sep 08 13:56:04.764504 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 34/66] 10.222.0.97 () {60 vars in 1286 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:04.777885 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.786310 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012887 Sep 08 13:56:04.786893 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 33/67] 10.222.0.97 () {60 vars in 1286 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:04.800632 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-50be98bc-821e-4328-a742-e3c38ed1218a admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.808722 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-50be98bc-821e-4328-a742-e3c38ed1218a admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012050 Sep 08 13:56:04.809370 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 35/68] 10.222.0.97 () {60 vars in 1283 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:30.758314 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:30.759343 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 08 13:59:30.759977 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 34/69] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:30.908628 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:SELECT=6 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:31.096125 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:31.101375 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:31.101853 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:31.102280 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:31.102990 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:31.103435 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:31.103851 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:31.138402 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-4a19dc7d-6202-4bb7-86a7-7c91cdeafcde admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.231148 Sep 08 13:59:31.139037 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 36/70] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:59:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:59:32.290016 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:32.291093 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 08 13:59:32.291560 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 35/71] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:59:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:32.500255 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:32.503790 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:32.504301 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:32.504818 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:32.505507 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:32.505888 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:32.506307 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:32.526999 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-c0c6fb53-5428-41f8-972d-5254c2a1759f admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.084090 Sep 08 13:59:32.528487 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 37/72] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:59:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:59:44.113306 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:44.114644 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Sep 08 13:59:44.115108 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 36/73] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:44.260196 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_cell0:SELECT=4 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:44.260940 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_cell1:SELECT=4 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:44.261573 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG dbcounter [-] [112880] Writing DB stats nova_api:SELECT=8 {{(pid=112880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:44.322202 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:44.326661 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:44.327147 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:44.327586 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:44.328363 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:44.333031 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:44.333031 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:44.355576 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-c8d47674-460d-4e01-b9df-8e967e73fb9f admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.099818 Sep 08 13:59:44.356212 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 38/74] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:59:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:59:45.502033 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG nova.api.openstack.wsgi [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] Calling method '>' {{(pid=112879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:45.503078 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: INFO nova.api.openstack.requestlog [None req-ed41f537-ea74-4ea2-adff-f64e5ee96469 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 08 13:59:45.503494 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: [pid: 112879|app: 0|req: 37/75] 10.222.0.97 () {56 vars in 1074 bytes} [Thu Sep 8 13:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:59:45.715094 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG nova.api.openstack.wsgi [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Calling method '>' {{(pid=112880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:45.718660 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:45.719141 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:45.719575 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:45.720336 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:45.720787 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:45.721208 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: DEBUG oslo_concurrency.lockutils [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:45.744234 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: INFO nova.api.openstack.requestlog [None req-463813aa-8572-4bf4-aee4-1f5afdaf16fd admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.099276 Sep 08 13:59:45.744830 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: [pid: 112880|app: 0|req: 39/76] 10.222.0.97 () {60 vars in 1193 bytes} [Thu Sep 8 13:59:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:00:43.004268 dv-cinder-856463-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 14:00:43.005213 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: Thu Sep 8 14:00:43 2022 - graceful shutdown triggered... Sep 08 14:00:43.005913 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: Gracefully killing worker 1 (pid: 112879)... Sep 08 14:00:43.006526 dv-cinder-856463-2-iscsi devstack@n-api.service[112880]: Gracefully killing worker 2 (pid: 112880)... Sep 08 14:00:43.137754 dv-cinder-856463-2-iscsi devstack@n-api.service[112879]: DEBUG dbcounter [-] [112879] Writing DB stats nova_api:SELECT=4 {{(pid=112879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:44.006379 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: worker 1 buried after 1 seconds Sep 08 14:00:44.006379 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: worker 2 buried after 1 seconds Sep 08 14:00:44.006379 dv-cinder-856463-2-iscsi devstack@n-api.service[112866]: goodbye to uWSGI. Sep 08 14:00:44.008110 dv-cinder-856463-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 14:00:44.008919 dv-cinder-856463-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 14:00:44.013577 dv-cinder-856463-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 14:00:44.033455 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 14:00:44 2022] *** Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: nodename: dv-cinder-856463-2-iscsi Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: machine: x86_64 Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: clock source: unix Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: pcre jit disabled Sep 08 14:00:44.036666 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: detected number of CPU cores: 4 Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: current working directory: / Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: detected binary path: /usr/bin/uwsgi-core Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: your processes number limit is 47680 Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: your memory page size is 4096 bytes Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: detected max file descriptor number: 2048 Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: lock engine: pthread robust mutexes Sep 08 14:00:44.037313 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: thunder lock: enabled Sep 08 14:00:44.037797 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 14:00:44.037797 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 14:00:44.093568 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: Python main interpreter initialized at 0x55cc9581d9c0 Sep 08 14:00:44.093568 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: python threads support enabled Sep 08 14:00:44.093568 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: your server socket listen backlog is limited to 100 connections Sep 08 14:00:44.093568 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: your mercy for graceful operations on workers is 90 seconds Sep 08 14:00:44.094023 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 14:00:44.094023 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: *** Operational MODE: preforking *** Sep 08 14:00:44.094309 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: *** uWSGI is running in multiple interpreter mode *** Sep 08 14:00:44.094309 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: spawned uWSGI master process (pid: 128386) Sep 08 14:00:44.094579 dv-cinder-856463-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 14:00:44.095377 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: spawned uWSGI worker 1 (pid: 128400, cores: 1) Sep 08 14:00:44.095747 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: spawned uWSGI worker 2 (pid: 128401, cores: 1) Sep 08 14:00:44.095747 dv-cinder-856463-2-iscsi devstack@n-api.service[128386]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 14:00:44.787589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 14:00:44.887903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 14:00:45.973716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 14:00:45.973716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: from cryptography.utils import int_from_bytes Sep 08 14:00:45.974496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 14:00:45.974496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: from cryptography.utils import int_from_bytes Sep 08 14:00:46.201466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 14:00:46.201466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: from cryptography.utils import int_from_bytes Sep 08 14:00:46.202276 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 14:00:46.202276 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: from cryptography.utils import int_from_bytes Sep 08 14:00:48.503805 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 14:00:48.504437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 14:00:48.504678 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 14:00:48.505055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 14:00:48.505354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 14:00:48.505721 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.506059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.506387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.506719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.507137 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.508063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.508063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.508063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.508508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.508737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.509062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.509597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-2-iscsi {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.509946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.510261 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.510582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.510916 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.511243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.511619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.511947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.512502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.515998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.516218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.516805 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-2-iscsi {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.517327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.517798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.518304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.518800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.519127 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.519480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.519884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.520274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.520582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.520879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.521211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.521509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.521914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.522213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.522548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.522832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.523170 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.523481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.523802 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.524075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.524403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.524770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.525111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.525538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.525816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.526080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.526414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.526748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.527074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.527930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.528282 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.528599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.528993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.529308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.529627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.529945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.530317 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.530646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.531012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.531330 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.531661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.532277 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.532459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.532674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.533055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.533359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.534374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.534374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.534374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.535122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.535122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.535438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.535609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.535964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.536271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.536531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.536847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.537160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.537522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.537842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.538245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.538531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.538850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.539183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.539561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.539821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.540224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.540485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.540726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.541262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.541499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.541736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.541994 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.542362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.542634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.543514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.543830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.544186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.544497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.544835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.545146 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.545470 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.545798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.546237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.546569 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.546818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.547095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.547442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.547734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.548083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.548478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.548754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.549073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.549741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.549741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.550234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.550660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.550660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.551139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.551606 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.551606 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.552339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.552339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.552974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.552974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.553367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.553565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.553868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.554212 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.554634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.554940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.555281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.555630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.555958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.556402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.556645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.556948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.557262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.557622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.557900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.558233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.558631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.558956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.559383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.560133 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.560436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.560808 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.561036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.561229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.561711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.561900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.562200 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.562549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.562881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.563220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.563560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.563884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.564272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.564598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.564989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.565423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.565662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.565961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.566286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.566673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.566921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.567395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.567802 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.568084 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.568376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.568609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.569132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.569370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.569613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.570354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.570354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.570839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.570839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.571430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.571674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.572065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.572065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.572707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.572707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.573297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.573509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.573748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.573969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.574467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.574789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.575115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.575478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.575797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.576123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.576562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.576931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.577248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.577502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.577908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.578189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.578512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.578863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.579258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.579505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.579809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.580552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.580552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.581012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.581401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.581401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.581903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.582287 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.582571 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.582970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.583363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.583363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.583821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.584047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.584447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.584682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.585082 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.585343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.585633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.585953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.586415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.586622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.586889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.587251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.587540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.587859 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.588310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.588525 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.588869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.589233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.589607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.590563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.590941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.591189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.591455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.591832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.592085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.592523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.592839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.593257 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.593672 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.593904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.594135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.594393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.594681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.595004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.595335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.595653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.595978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.596477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.596735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.597054 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.597440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.597687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.598019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.598426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.598662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.598974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.599295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.599859 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.600120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.600370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.600770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.601204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.601440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.601660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.602055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.602296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.602571 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.603003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.603276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.603836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.603836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.604320 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.604558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.604839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.605294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.606095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.606378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.606806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.607512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.607767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.608030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.608366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.608869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.609102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.609354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.609622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.610010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.610336 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.610672 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.611106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.611501 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.611679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.611930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.612295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.612652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.613135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.613374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.613690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.614216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.614365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.614632 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.614965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.615290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.615623 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.615947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.616299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.616639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.616969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.617293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.617658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.617988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.618318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.618669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.619010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.619333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.619659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.619979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.620377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.620717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.621282 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.621679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.622010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.622339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.622671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.623028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.623399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.623745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.624239 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.624466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.624793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.625118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.625433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.625751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.626073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.626398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.626750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.627116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.627429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.627805 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.628202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.628452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.628764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.629175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.629440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.629670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.629923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.630305 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.630626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.630941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.631345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.631608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.631991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.632552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.632810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.633048 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.633595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.633860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.634128 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.634697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.634697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.635121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.635316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.635614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.636128 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.636449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.636712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.636928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.637268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.637555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.637869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.638195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.638556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.638889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.639306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.639538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.639855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.640204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.640521 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.640838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.641164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.641573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.641824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.642269 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.642491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.642893 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.643125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.643396 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.643842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.644095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.644340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.644932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.644932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.645379 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.645604 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.645877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.646265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.646510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.646996 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.647193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.647497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.647812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.648130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.648466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.648783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.649101 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.649397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.649731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.650013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.650331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.650742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.651054 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.651367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.651757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.651997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.653059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.653319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.653642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.654055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.654272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.654594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.654966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.655343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.655603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.655839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.657799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.658431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.658431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.658905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.659151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.659612 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.659612 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.660263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.660481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.660645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.660950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.661271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.661594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.661923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.663910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.663910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.663910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.663910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.663910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.664830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.664830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.664830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.665678 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.665678 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.666083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.666083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.666495 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.666836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.667144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.667469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.667896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.668723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.669058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.669379 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.669716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.670124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.670359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.670772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.671095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.671417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.671744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.672321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.672613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.672826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.673053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.673405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.673759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.674137 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.674408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.674724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.675036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.675714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.675943 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.676243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.676545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.676918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.677189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.677512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.678001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.678235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.678527 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.678863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.679178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.679557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.679895 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.680276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.680600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.680921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.681258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.681592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.682056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.682249 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.682679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.683017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.683344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.683712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.684052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.684461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.685025 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.685451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.685740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.686325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.686325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.686800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.687038 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.687391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.687661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.687871 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.688240 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.688543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.688864 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.689194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.689519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.689855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.690191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.690641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.690858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.691186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.691496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.691813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.692128 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.692582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.692835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.693167 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.693514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.693854 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.694183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.694649 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.694905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.695220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.695619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.695900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.696561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.696561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.697049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.697288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.697676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.697914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.698195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.698593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.698846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.699614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.699853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.700165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.700539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.700919 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.701162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.701480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.701799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.702116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.702517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.702961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.703215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.703464 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.703792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.704210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.704487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.704899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.705226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.705484 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.705883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.706251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.706876 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.706876 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.707373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.707373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.707981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.708311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.708715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.709008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.709278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.709653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.709918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.710288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.710643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.711056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.711349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.711617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.711943 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.712341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.712701 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.713136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.713400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.713681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.714019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.714393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.714772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.715718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.716020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.716442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.718289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.719865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.719865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.719865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.719865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.719865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.721191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.721191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.721191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.721191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.722265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.722265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.722715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.722956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.723246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.723650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.723905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.724189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.724434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.724722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.725046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.725427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.725928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.726175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.726451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.726817 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.727099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.727699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.727947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.728271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.728693 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.728959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.729393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.729998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.729998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.732011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.732011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.732011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.732613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.732773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.733073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.733402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.733733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.734064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.734388 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.734712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.735066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.735414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.735736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.736098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.736477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.736839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.737194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.737514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.737837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.738151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.738480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.738798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.739244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.739675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.739938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.740265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.740592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.740913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.741259 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.741580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.741899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.742273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.742598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.742934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.743265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.743590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.743952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.744415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.744935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.745283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.745620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.745996 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.746343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.746663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.746980 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.747299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.747638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.747993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.748354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.748679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.749051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.749360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.749687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.750008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.750332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.750656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.750978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.751301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.751621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.751952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.752300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.752705 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.753073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.753408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.753759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.754097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.754420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.754749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.755074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.755397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.755720 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.756045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.756413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.756740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.757057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.757504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.757829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.758152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.758523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.758846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.759205 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.759543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.759873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.760231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.760561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.760937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.761293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.762155 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.762500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.762832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.763148 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.763460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.763784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.764123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.764475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.764795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.765110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.765476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.765792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.766161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.766488 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.766810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.767136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.767481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.767801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.768116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.768458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.768780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.769092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.769415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.769730 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.770048 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.770398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.770713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.771062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.771419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.771762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.772090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.772476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.772797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.773209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.773437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.773769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.774102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.774438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.774758 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.775104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.775469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.775830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.776178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.776509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.776833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.777180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.777556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.777897 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.778214 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.778586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.778918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.779252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.779581 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.779901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.780282 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.780605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.780928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.781251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.781574 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.781896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.782229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.782598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.782921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.783250 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.783579 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.783925 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.784325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.784655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.784999 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.785338 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.785707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.786037 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.786391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.786729 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.787057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.787420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.787739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.787995 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 14:00:48.826142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 14:00:48.826787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 14:00:48.826937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 14:00:48.827329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 14:00:48.827584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 14:00:48.827977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.828323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.828652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.828980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.829310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.829626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.830020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.830326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.830657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.830920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.831858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.831858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-2-iscsi {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.831858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.832193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.832509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.832831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.833139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.833468 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.833774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.834287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.834598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.834906 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.835232 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.835559 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.835869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.836204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.836523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.836831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.837233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.837518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.837860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-2-iscsi {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.838181 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.838496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.838865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.839287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.839600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.840504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.840943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.841303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.841628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.841974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.842292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.842613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.842935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.843242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.843553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.843864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.844284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.844599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.844948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.845156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.845464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.845793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.846113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.846437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.846689 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.846937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.847302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.847637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.847952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.848286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.848631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.848907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.849446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.849576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.849816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.850126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.850451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.850768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.851101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.851414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.851730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.852169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.852280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO dbcounter [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Registered counter for database nova_api Sep 08 14:00:48.852411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.852721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.853065 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.853386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.853700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.854021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.854343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.854654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.854965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.855300 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.855642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.855976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.856307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.856562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.856868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.857175 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.857496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.857806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.858115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.858427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.858729 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.859043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.859454 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.859652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.859961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.860289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.860596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.860907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.861211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.861593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.861817 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.862139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.862585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.862783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.863072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.863378 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.863796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.864008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.864338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.864646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.864968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.865280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.865581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.865897 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.866205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.866640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.866813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.867114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.867500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.867830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.868360 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.868490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.868758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.869475 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.870073 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.870414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.871655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.871655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.871655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.871655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.871994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.872280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.872588 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.872896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.873221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 14:00:48.873566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.873906 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.874247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.874565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.874910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.875244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.875569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.875889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.876442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.876790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.877091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880547 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.880646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.881386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.881386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.881386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.881604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.881935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.882253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.882581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.882908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.883226 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.883537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.884209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.884329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.884707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.885020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.885355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.885678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.886005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.886320 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.887212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.887480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.887794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.888110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.888478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.889403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.889403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.889403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.889722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.890027 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.890344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.890659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.890971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.891284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.891590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.891712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writer thread running {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:48.892081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.892446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.892536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.892915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.893316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.893508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.894055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.894371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.894691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.895011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.895328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.895637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.895953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.896290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.896600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.896927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.897241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.897577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.897904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.898211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.898519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.898839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.899153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.899470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.899782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.900091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.900439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.900749 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.901061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.901455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.901851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.902179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.903033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.903361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.903675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.904001 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905288 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.905900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.906212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.906508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.906815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.907327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.907446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.907738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.912963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.913507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.913589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.914370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.914370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.914553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.914831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.915139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.915463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.915809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.916169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.916506 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.916822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.917268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.917647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.917995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.918309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.918635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.918972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.919319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.919637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.919966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.920301 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.920630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.920943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.921273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.921575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.921904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.922223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.922557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.922867 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.923179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.923501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.923815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.924126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.924476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.924783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.925092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.925484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.925800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.926115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.926426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.926739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.927034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.927348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.927652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.927955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.928338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.928627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.928939 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.929260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.929582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.929887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.930192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.930520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.930912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.931221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.931537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.931840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.932233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.932522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.932827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.933146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.933497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.933811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.934132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.934443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.935009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.935340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.935661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.935965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.936303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.936619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.936931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.937246 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.937574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.937887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.938198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.938510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.938815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.939127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.939449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.940033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.940417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.940742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.941064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.941412 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.941739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.942073 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.942406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.942726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.943032 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.943346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.943682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.944078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.944409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.944722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.945168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.945627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.945955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.946351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.946697 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.947039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.947351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.947850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.950462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.950462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.950462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.950462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.952703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.952703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.952703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.952703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.952703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.955777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.955777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.955777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.956040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.context [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ddabd24-226a-4d6c-890f-c80b419c7ead(cell1) {{(pid=128401) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 14:00:48.956185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.956185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.956185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.956607 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.957417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.957417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.957807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.958136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.958459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.959108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.959503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.959973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.960384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.960554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.960967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.961202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.961578 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.962282 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.962768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.963306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.963475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.963832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.964334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.964531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:48.964924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.965637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:48.965949 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.966424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.967791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.967791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.967791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.968412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:48.968590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.968797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.969021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.969307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.969658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.970457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.970457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.970906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO dbcounter [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Registered counter for database nova_cell0 Sep 08 14:00:48.971143 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.971732 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.971942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.972210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.972723 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.973045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.973493 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.974137 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.974584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.974976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.975290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.975693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.975937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO dbcounter [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Registered counter for database nova_cell1 Sep 08 14:00:48.976236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.976500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.976939 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.978058 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.978058 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.978428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.979463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.980537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.984941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.985637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.986186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.986680 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.987174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.987840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.988309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.988692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.989074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.989403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.989745 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.990084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.990424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.990750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.991077 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.991562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.991895 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.992269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.992599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.992715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:48.993156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.993321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.993626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.993774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:48.993903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.994196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.994520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.995042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.995200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.995497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.996067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.996246 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.996505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.996834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.997157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.997478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.997806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.998123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.998557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.998841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.999147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.999392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:48.999827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.000003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.000367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.000781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.001009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.001451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.001904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.002210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.002454 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.002819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.003143 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.003523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.003844 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.004008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writer thread running {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.004561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.004561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.004867 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.005238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.005420 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.005839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.006101 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writer thread running {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.006318 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.006670 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.006863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.007160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.007371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.007669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.008002 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.008343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.008660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.008961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.009291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.009604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.009939 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.010365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.010687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.011001 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.012118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.012463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.012711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.012959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.013250 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.013862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.013862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.014357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.014609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.014863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.015130 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.015466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.015781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.016092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.016452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.016782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.017101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.017436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.017873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.018327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.018611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.018877 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.019387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.019630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.019814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.020071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.020429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.020739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.021071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.021389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.021700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.022019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.022442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.022620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.022936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.023263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.023572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.024105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.024435 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.024679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.024928 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.025173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.025501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.025818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.026126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.026439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.026825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.027203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.028067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.028458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.028753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.029171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.029394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.029864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.030087 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.030380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.030698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.031024 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.031356 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.031675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.031980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.032318 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.032670 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.032923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.033237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.033556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.033864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.034319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.034515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.034793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.035107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.035441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.035832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.036238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.036473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.036757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.037112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.037426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.037764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.038242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.038420 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.038733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.039040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.039502 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.039739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.040294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.040294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.040784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.041030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.041280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.041609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.041937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.042890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.043210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.043674 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.044002 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.044506 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.044951 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.045358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.045717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.046043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.046365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.046686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.047032 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.047365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.047706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.048053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.048733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.048733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.049353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.049353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.050017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.050017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.050837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.050837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.051314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.051314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.051783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.052061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.052336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.052571 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.053003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.053414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.053414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.053900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.054137 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.054572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.054826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.055274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.055535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.055774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.056298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.056624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.056970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.057303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.057638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.058146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.058450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.058885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.059154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.059814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.060072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.060828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.060828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.061311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.061311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.061764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.062022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.062272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.062728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.063133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.063411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.063824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.064080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.064370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.064794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.065082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.065524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.065790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.066094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.066419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.066736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.067048 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.067371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.067691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.070092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.072415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.075157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.077090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.078490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.078490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.078490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.079238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.079238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.079693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.079693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.080292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.080292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.080766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.081518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.081518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.082029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.082029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.082517 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.082844 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.083165 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.083641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.084481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.084783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.085341 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.085341 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.085852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.086304 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.086773 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.086773 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.087441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.087721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.087962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.088316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.088644 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.088970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.089293 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.090431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.091678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.091960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.092247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.092614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.092935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.093355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.094090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.094601 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.094901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.095362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.095609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.095946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.096342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.096625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.096954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.097278 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.097678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.098037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.098375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.098711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.099121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.099710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.099877 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.100119 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.100469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.100790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.101131 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.101613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.101900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.102218 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.102538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.102852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.103168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.103486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.104260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.104260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.109956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.110998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.112281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.113985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.114259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.114598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.114969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.115255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.115656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.116044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.116411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.116734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.117056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.117378 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.117699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.118020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.118348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.118669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.118989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.119337 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.119827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.120094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.120493 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.120889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.121912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.122361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.122650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.122976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.123335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.123674 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.124001 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.124348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.124667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 14:00:49.125727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 14:00:49.174788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO dbcounter [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Registered counter for database nova_cell0 Sep 08 14:00:49.183198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:49.189307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writer thread running {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.284249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO dbcounter [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Registered counter for database nova_api Sep 08 14:00:49.306477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:49.319444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writer thread running {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.417201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.context [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ddabd24-226a-4d6c-890f-c80b419c7ead(cell1) {{(pid=128400) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 14:00:49.421426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.422598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.425602 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.426795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:49.427569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:49.429987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:49.432161 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO dbcounter [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Registered counter for database nova_cell0 Sep 08 14:00:49.437463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO dbcounter [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Registered counter for database nova_cell1 Sep 08 14:00:49.446238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:49.450122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:49.458857 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writer thread running {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.461678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writer thread running {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.527901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: WARNING keystonemiddleware.auth_token [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 14:00:49.535642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: WARNING keystonemiddleware.auth_token [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 14:00:49.615296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO dbcounter [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Registered counter for database nova_cell0 Sep 08 14:00:49.623955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 14:00:49.630068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writer thread running {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 14:00:49.907835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: WARNING keystonemiddleware.auth_token [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 14:00:49.915132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: WARNING keystonemiddleware.auth_token [None req-cc1e325f-d8af-42b3-a229-71a474c8cde9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 14:00:49.922220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cc9581d9c0 pid: 128401 (default app) Sep 08 14:00:50.134898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: WARNING keystonemiddleware.auth_token [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 14:00:50.146857 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: WARNING keystonemiddleware.auth_token [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 14:00:50.499709 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: WARNING keystonemiddleware.auth_token [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 14:00:50.506005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: WARNING keystonemiddleware.auth_token [None req-2d5e9008-3fe2-4d02-9987-3ac122a5787b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 14:00:50.511581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc9581d9c0 pid: 128400 (default app) Sep 08 14:01:35.955816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=3 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:35.957482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=3 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:35.958723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=3 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:35.969932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=3 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:36.478118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-45d2b447-1d6d-4717-a662-b5fe81a870dc tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8c045940>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:37.687733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-45d2b447-1d6d-4717-a662-b5fe81a870dc tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/9c44b1ea-16cb-4340-95ee-5ae2542648af" status: 200 len: 351 microversion: 2.1 time: 1.736743 Sep 08 14:01:37.689326 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 1/1] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:01:35 2022] GET /compute/v2.1/os-volumes/9c44b1ea-16cb-4340-95ee-5ae2542648af => generated 351 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:41.545237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:41.556374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:41.560290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:41.565642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:42.219653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-917059f5-e4f7-44d8-9fa4-4ccb89dcf136 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bffff70>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:44.003620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-917059f5-e4f7-44d8-9fa4-4ccb89dcf136 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ca37e1af-a5db-4ddc-8faf-3a865de69e12" status: 200 len: 350 microversion: 2.1 time: 2.509507 Sep 08 14:01:44.019318 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 1/2] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:01:41 2022] GET /compute/v2.1/os-volumes/ca37e1af-a5db-4ddc-8faf-3a865de69e12 => generated 350 bytes in 2528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:45.577696 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-254522092", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:45.732407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] validate_networks() for [('182a2fc0-a3a1-4a15-a5cd-df587300306f', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:01:47.704837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-601ea827-6f81-40f0-a3af-15e1b42a0371 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bdf91f0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:47.901230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-601ea827-6f81-40f0-a3af-15e1b42a0371 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/6018899f-bf46-4e26-af60-630f655a5245" status: 200 len: 351 microversion: 2.1 time: 0.191173 Sep 08 14:01:47.901230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 2/3] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:01:47 2022] GET /compute/v2.1/os-volumes/6018899f-bf46-4e26-af60-630f655a5245 => generated 351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:01:47.914138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-46600512-15ab-477e-a5ad-8bf6505158f2 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bdf98b0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.170704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-46600512-15ab-477e-a5ad-8bf6505158f2 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.267308 Sep 08 14:01:48.181969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 3/4] 10.222.0.97 () {58 vars in 1134 bytes} [Thu Sep 8 14:01:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:48.188059 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1103de0f-ff70-4151-98f3-1395b4f47180 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bdf9670>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.448926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1103de0f-ff70-4151-98f3-1395b4f47180 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.265331 Sep 08 14:01:48.449633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 4/5] 10.222.0.97 () {58 vars in 1149 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:48.469734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ecb7442f-5cfb-4afd-8644-386128366724 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8be1c430>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.735363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ecb7442f-5cfb-4afd-8644-386128366724 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.272203 Sep 08 14:01:48.744758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 5/6] 10.222.0.97 () {58 vars in 1134 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:48.757776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2045c107-aaeb-452c-9c70-4b002bd98ece tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bdf9160>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.973205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2045c107-aaeb-452c-9c70-4b002bd98ece tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223815 Sep 08 14:01:48.974217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 6/7] 10.222.0.97 () {58 vars in 1167 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:01:48.994785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d061efb6-68cc-4c0c-b3c5-b41061d5c4b4 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8be240d0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.161050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:01:49.161050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:01:49.161050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:01:49.161894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:01:49.161894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:01:49.214485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.216671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.218328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.221979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.222728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.223242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.336530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d061efb6-68cc-4c0c-b3c5-b41061d5c4b4 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.350320 Sep 08 14:01:49.339380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 7/8] 10.222.0.97 () {58 vars in 1170 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:49.350031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:49.361236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-98c20367-66ca-444d-ba37-f25c023b1b77 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8be2b430>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.376458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for user a30b0734975d4e5a848be44aa7860807 and project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:49.502532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:01:49.522550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:01:49.783931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-98c20367-66ca-444d-ba37-f25c023b1b77 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.426509 Sep 08 14:01:49.784683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 8/9] 10.222.0.97 () {58 vars in 1155 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:49.799255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7dab83d-8b46-413c-832d-fa2d78f77097 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8be1cdc0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.998625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c6f279e8-1b00-4332-b42a-4e8a4f6f5cca tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.628734 Sep 08 14:01:50.009019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 2/10] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:01:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 4640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:01:50.024755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a2a47a10-b429-4fe2-8201-416127abc406 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:50.025637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a2a47a10-b429-4fe2-8201-416127abc406 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:50.204190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f7dab83d-8b46-413c-832d-fa2d78f77097 tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.409188 Sep 08 14:01:50.205046 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 9/11] 10.222.0.97 () {58 vars in 1188 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:50.222875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1b251760-8445-4b84-a4d9-3971d10ed17a tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] Calling method '.version_select at 0x7f7f8bdf9310>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:50.407272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1b251760-8445-4b84-a4d9-3971d10ed17a tempest-VolumesTestJSON-1704369851 tempest-VolumesTestJSON-1704369851-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190454 Sep 08 14:01:50.407923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 10/12] 10.222.0.97 () {58 vars in 1155 bytes} [Thu Sep 8 14:01:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:50.545805 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a2a47a10-b429-4fe2-8201-416127abc406 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:50.586897 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a2a47a10-b429-4fe2-8201-416127abc406 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1221 microversion: 2.1 time: 0.570678 Sep 08 14:01:50.602395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 3/13] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:50 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1221 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:51.107200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1234501742", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:51.346945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] validate_networks() for [('182a2fc0-a3a1-4a15-a5cd-df587300306f', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:01:51.842092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1599924191", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "networks": [{"uuid": "75351fd7-e93d-4766-b283-c15b1b0e6276"}]}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:52.076192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] validate_networks() for [('75351fd7-e93d-4766-b283-c15b1b0e6276', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:01:53.689971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:01:53.690656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:01:53.691263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:01:53.691717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:01:53.692160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:01:53.721363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.724297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.725031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.728584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:53.729331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:53.731904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:53.794209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Getting quotas for project 9cfcfe1ebb994061b6d203510fd7e65b. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:53.810734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Getting quotas for user c96336eb4bfd461e82e7761077a5b910 and project 9cfcfe1ebb994061b6d203510fd7e65b. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:53.834561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:01:53.837596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:01:54.173292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bf5b5a31-43bc-49b0-9de8-0773af3c3b6d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.790758 Sep 08 14:01:54.206726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 4/14] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:01:55.004349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:01:55.005558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:01:55.006344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:01:55.007024 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:01:55.007668 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:01:55.056509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9dd24f73-8c3c-4787-ba12-5bc9f7870504 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: .version_select at 0x7f7f8b531a60>, body: {"keypair": {"name": "tempest-keypair-1871236463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPArTdZu0lYmmh4hzfDBBac4HEf2WFhATUAPF7uyqct5g4oYNG0eYlUW8ellWyVG69ChbTbtAgF5d02Wriuyp2IvjlbMkxwHTzgYEu8VzgJHtw7jxu4skXPIvaOMh6x6lA=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:55.121450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.125948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.130869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:55.133932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:55.135659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:55.142448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:55.155242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-9dd24f73-8c3c-4787-ba12-5bc9f7870504 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:55.170939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-9dd24f73-8c3c-4787-ba12-5bc9f7870504 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for user c18dc6b5898c4e1aae71a028b4840bf0 and project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:55.244966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:55.258867 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for user a30b0734975d4e5a848be44aa7860807 and project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:55.301431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:01:55.352753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:01:55.469807 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9dd24f73-8c3c-4787-ba12-5bc9f7870504 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.257677 Sep 08 14:01:55.476347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 5/15] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:01:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:55.488927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e4d30d4f-2f24-48f4-89e9-69dee127c942 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:55.490412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e4d30d4f-2f24-48f4-89e9-69dee127c942 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:55.684294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e4d30d4f-2f24-48f4-89e9-69dee127c942 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:55.720272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e4d30d4f-2f24-48f4-89e9-69dee127c942 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1215 microversion: 2.1 time: 0.236784 Sep 08 14:01:55.726168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 6/16] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:55 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:55.816639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-028f256b-fec0-49ac-a456-25968f8ab7c4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.716235 Sep 08 14:01:55.818380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 11/17] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:01:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 4719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:01:55.831707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b94d7c7e-4330-476d-b09f-451793f9f665 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:55.832370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b94d7c7e-4330-476d-b09f-451793f9f665 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:55.955804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b94d7c7e-4330-476d-b09f-451793f9f665 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:55.964195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b94d7c7e-4330-476d-b09f-451793f9f665 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1222 microversion: 2.1 time: 0.136605 Sep 08 14:01:55.983996 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 7/18] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:55 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:56.754975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-eb3509ca-202c-4081-816e-7bc254483599 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:56.759217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-eb3509ca-202c-4081-816e-7bc254483599 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.014432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-eb3509ca-202c-4081-816e-7bc254483599 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:57.050326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-eb3509ca-202c-4081-816e-7bc254483599 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1215 microversion: 2.1 time: 0.307858 Sep 08 14:01:57.053551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 12/19] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:56 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:57.070675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d7118990-3a96-4dbd-b350-3e24ee426a06 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:57.072367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d7118990-3a96-4dbd-b350-3e24ee426a06 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:57.217097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d7118990-3a96-4dbd-b350-3e24ee426a06 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:57.230966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d7118990-3a96-4dbd-b350-3e24ee426a06 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1222 microversion: 2.1 time: 0.169038 Sep 08 14:01:57.232604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 13/20] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:57 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:58.098905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:58.100861 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:58.125505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:58.128298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:58.131299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:58.132767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:58.133529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:58.134244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:58.414824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4626862c-3a1e-472b-a690-3a7f009ca5b6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: .version_select at 0x7f7f8b4e0940>, body: {"keypair": {"name": "tempest-keypair-664246500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8lQWdzvKj4OSDJ8Ge0n95i2lS82AaRbrnMarGEHqHo3pr1RGZwgAJcmdhCkwHzA4DeYhQTA4v8CqtReilyIggT0PtB7MNJIS3SKlTadE+eHEGXFTZd3CjolIvOIFjaFw=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:58.474327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-4626862c-3a1e-472b-a690-3a7f009ca5b6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:01:58.480887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-4626862c-3a1e-472b-a690-3a7f009ca5b6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:01:58.758933 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:58.794627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4626862c-3a1e-472b-a690-3a7f009ca5b6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.864790 Sep 08 14:01:58.803820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 8/21] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:01:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:01:58.803952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-27b60b39-e198-423c-8f66-01f2ebc0c16b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1219 microversion: 2.1 time: 0.711195 Sep 08 14:01:58.808619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 14/22] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:58 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1219 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:58.809770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:58.813323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:58.845536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:58.847277 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:58.848060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:58.849177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:58.849814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:58.850434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.331586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:59.369192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0096bdba-177a-4677-a342-0ed94559a8a3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1226 microversion: 2.1 time: 0.569451 Sep 08 14:01:59.379258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 9/23] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:58 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1226 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:59.839520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:59.842099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:59.854016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.854946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.857256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:59.858333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:59.861786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:59.863088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.107915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:00.130632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2818f4a0-b814-4d20-bf55-d2d9ee9ea736 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1211 microversion: 2.1 time: 0.293023 Sep 08 14:02:00.135439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 15/24] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:59 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1211 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:00.423360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:00.426360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:00.457293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.462512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.463488 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:00.465945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:00.467137 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:00.468290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.076912 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.121744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8653d887-cd1a-4c1f-8ce1-4915cad6d71d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1218 microversion: 2.1 time: 0.699502 Sep 08 14:02:01.122878 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 10/25] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:00 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1218 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:01.164948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:01.173038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:01.190259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.191480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.193303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.194965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:01.202172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:01.203594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:01.616476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:01.625764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f3afdb3f-86f7-4162-aabe-165cc28b671e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1267 microversion: 2.1 time: 0.468560 Sep 08 14:02:01.632574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 16/26] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:01 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1267 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:02.154347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:02.155422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:02.196792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.197699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.228796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.241096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.242378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.253062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.677026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:02.677026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:02.687778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:02.695558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.696026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.699383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.702447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:02.703274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:02.704760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:02.763267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ef69e53d-b250-48d1-8f59-2b81effd0400 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1274 microversion: 2.1 time: 0.615442 Sep 08 14:02:02.765927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 11/27] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:02 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1274 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:03.352950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:03.372873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-209c60bc-dc1d-496b-91cc-221865c44547 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1273 microversion: 2.1 time: 0.709846 Sep 08 14:02:03.373807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 17/28] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:02 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1273 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:03.801383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:03.803802 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:03.808080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:03.821051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.822420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.825308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:03.827357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:03.828824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:03.830140 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.371926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.371926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1b62ec4e-c5ce-48dd-bc46-ace2988052e4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1292 microversion: 2.1 time: 0.524639 Sep 08 14:02:04.371926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 12/29] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:03 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1292 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:04.397750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:04.399727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:04.416123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.416796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.417319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.418785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:04.447100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:04.469072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:04.731713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:04.748672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2de144d6-25af-44a6-bca2-8e7290ace008 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1273 microversion: 2.1 time: 0.355727 Sep 08 14:02:04.749588 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 18/30] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:04 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1273 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:05.379991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:05.389032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:05.449011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-599557900", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39e2cb88-2879-4ba3-b085-907a39189f3c"}], "security_groups": [{"name": "tempest-securitygroup--296713028"}], "key_name": "tempest-keypair-1871236463", "user_data": "}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:05.451552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.452116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.453640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.475092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.476265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.477026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.525870 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:05.858208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:05.875226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f654db08-8408-430e-b7ad-668788dc6e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1280 microversion: 2.1 time: 0.501691 Sep 08 14:02:05.875226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 13/31] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:05 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1280 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:05.903007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:05.904007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:05.931820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.933112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.934100 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:05.936380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:05.941439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:05.944014 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.230296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:06.243829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] validate_networks() for [('39e2cb88-2879-4ba3-b085-907a39189f3c', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:06.260830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-38f8c521-ee42-49af-9a58-b1842325a51a tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1273 microversion: 2.1 time: 0.361417 Sep 08 14:02:06.276198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 14/32] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:05 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:06.930566 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:06.931345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:06.947783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.948529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.949715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:06.950676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:06.951345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:06.951934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.229093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=10 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:07.475534 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:07.485958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cc5f2a89-8882-4983-b83c-bc29372ac59b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1280 microversion: 2.1 time: 0.562426 Sep 08 14:02:07.497378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 15/33] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:06 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1280 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:07.502771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:07.505887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:07.531709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.531709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.532129 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:07.535586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:07.536410 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:07.537242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.469159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:08.469977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:08.471152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:08.472546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:08.473698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:08.492393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=26 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:08.498653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:08.518319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.519262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.520085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.521581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.522017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.522642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.524583 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f4540d70-a70c-44e2-ac88-e5b3988e263c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 1.025166 Sep 08 14:02:08.531935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 16/34] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:07 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:08.544575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:08.546063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:08.563161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.564724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.566242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.567603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:08.568554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:08.569438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:08.582510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:08.597783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for user c18dc6b5898c4e1aae71a028b4840bf0 and project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:08.620672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:08.627051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:08.880546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5b4e2808-5569-4717-9db6-0825c11e3b7a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.463567 Sep 08 14:02:08.883509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 19/35] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 3469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:02:08.917317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1c7c1cd2-a45a-4c0b-9eac-56c2fdb89f1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:08.941523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1c7c1cd2-a45a-4c0b-9eac-56c2fdb89f1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:09.308911 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1c7c1cd2-a45a-4c0b-9eac-56c2fdb89f1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:09.338194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1c7c1cd2-a45a-4c0b-9eac-56c2fdb89f1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1237 microversion: 2.1 time: 0.431272 Sep 08 14:02:09.342765 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 20/36] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:08 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1237 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:09.492092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:09.505911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4a05e43c-022c-4479-9513-2b4045317844 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.971614 Sep 08 14:02:09.507508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 17/37] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:08 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:09.565208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:09.566377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:09.573556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.574148 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.574607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.575326 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.575804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.576274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.653883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef13e6e-be3d-4cf5-977c-08a0521e5190", "tag": "a1b41d99-de62-4f6e-bc67-196b31315976"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:09.679612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.680514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.681184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.723240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Creating event network-changed:a1b41d99-de62-4f6e-bc67-196b31315976 for instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 on hv-cinder-85646 Sep 08 14:02:09.725487 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 14:02:09.729156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-7ebddd7c-e8d5-4905-a380-57134064f923 req-5bdae575-13f9-4054-a47f-ce7a2cab07e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 14:02:09.731173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.744368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.744914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.746398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:09.746927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:09.747393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:09.769550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.compute.rpcapi [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 14:02:09.769550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] Releasing lock "compute-rpcapi-router" {{(pid=128400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 14:02:09.788878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aabef704-a292-4fa3-ba49-3c0cc68de041 None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443995 Sep 08 14:02:09.789757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 21/38] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:09.869639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:09.915337 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-54769b7e-6d8b-4c28-aa03-25ca9533bc90 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.357650 Sep 08 14:02:09.926403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 18/39] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:09 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:10.055317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1122665019", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ef396a-7d6a-46fb-a5b2-7b67636f85e3"}], "security_groups": [{"name": "tempest-securitygroup--1656516498"}], "key_name": "tempest-keypair-664246500", "user_data": "}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:10.345034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] validate_networks() for [('21ef396a-7d6a-46fb-a5b2-7b67636f85e3', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:02:10.383220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2fdb4b8b-5be2-4fbd-a076-fa29b8e5fd4a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.385119 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2fdb4b8b-5be2-4fbd-a076-fa29b8e5fd4a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.508181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2fdb4b8b-5be2-4fbd-a076-fa29b8e5fd4a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.517636 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2fdb4b8b-5be2-4fbd-a076-fa29b8e5fd4a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1237 microversion: 2.1 time: 0.138227 Sep 08 14:02:10.532181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 19/40] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1237 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:10.555546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.555546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.564016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.565041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.565517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.566461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.566853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.567301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.869132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:10.885776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a890c8af-6b6e-470f-87d7-a64718964548 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.335958 Sep 08 14:02:10.911256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 20/41] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:10.952182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:10.952843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:10.964683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.965256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.968774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:10.969656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:10.970188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:10.970609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.370411 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.385220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cdc20487-ed5f-4189-bcba-a838a565969e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.435239 Sep 08 14:02:11.396426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 21/42] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:10 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:11.408917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:02:11.415985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:02:11.418698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:02:11.419832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:02:11.422527 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:02:11.441041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.442064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.442874 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.444121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.445018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.446539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.517580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:02:11.523451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:02:11.548225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.549516 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.552061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:02:11.563777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:02:11.564880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.566501 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.567352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.572180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.575773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.580508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.743631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:11.770156 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fac1ee7b-0d48-4a7d-870e-506051f2f989 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1241 microversion: 2.1 time: 0.231427 Sep 08 14:02:11.776179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 22/43] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1241 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:11.831656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-637214c4-96f8-4705-9751-1cb9dc553fe2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.773836 Sep 08 14:02:11.839830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 22/44] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:02:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:02:11.847467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c64a590a-84d8-48a3-ad89-a0c2c927a4b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.848307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c64a590a-84d8-48a3-ad89-a0c2c927a4b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.851833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:11.903783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:11.903783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:11.922259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.922824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.923305 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:11.924093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:11.938180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:11.938642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.148937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c64a590a-84d8-48a3-ad89-a0c2c927a4b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.165719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c64a590a-84d8-48a3-ad89-a0c2c927a4b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1241 microversion: 2.1 time: 0.323373 Sep 08 14:02:12.167017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 23/45] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1241 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:12.371943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.400028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1030856b-f4ff-4c8e-a733-8646a955ce2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.501332 Sep 08 14:02:12.400675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 23/46] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:11 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:12.423121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:12.423758 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:12.438352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.441880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.451057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.451057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.451346 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.452238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.798500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:12.799285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:12.813040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.814064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.814802 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.817880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:12.818623 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:12.820938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:12.892865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.892865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-542285bb-725a-4967-8e47-63e0c7a4b384 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.469566 Sep 08 14:02:12.892865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 24/47] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:12 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:12.963193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:12.976586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-26b2af04-19bc-43e6-acc2-c2f642746654 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.181959 Sep 08 14:02:12.989127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 24/48] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:12 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:13.201584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-117b72bc-f006-4e14-8093-b20b564bf1f9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.207683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-117b72bc-f006-4e14-8093-b20b564bf1f9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.352813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-117b72bc-f006-4e14-8093-b20b564bf1f9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.378986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-117b72bc-f006-4e14-8093-b20b564bf1f9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1241 microversion: 2.1 time: 0.186536 Sep 08 14:02:13.394053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 25/49] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:13.446354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.454474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.487383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.489785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.490691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.492595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.493846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.495129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.721743 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:13.731138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6dfe4fca-335a-4251-8149-6098085b1879 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.298479 Sep 08 14:02:13.731739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 25/50] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:13.912351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:13.912351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:13.921985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.922685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.923040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:13.924984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:13.925466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:13.925910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.009056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.010375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.013842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:14.037000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.039798 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.041387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.042285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.043727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.046168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.235303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.250224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.250338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-80409565-cd45-4f4c-a5f9-05ffd394cce6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.248595 Sep 08 14:02:14.250338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 26/51] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:14.258749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-13e44557-52c4-4eb5-8fb8-088f0d2cc7ce tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.353698 Sep 08 14:02:14.260782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 26/52] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:13 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:14.307330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ce34a4-1425-461c-a3f2-9c33ee80711a", "tag": "2be35524-3109-4419-9c9d-3db11f8850f7"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:14.327832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.328649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.329616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.359205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] Creating event network-changed:2be35524-3109-4419-9c9d-3db11f8850f7 for instance f5ce34a4-1425-461c-a3f2-9c33ee80711a on hv-cinder-85646 Sep 08 14:02:14.367444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-5cec171b-b2a8-4b3a-9116-ea0a6da2c962 req-d23bd28e-3c1a-48e0-9331-e27f6da017c3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064981 Sep 08 14:02:14.368700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 27/53] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:14.450223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da496ec0-bf9f-4f44-8a5d-4421d42fcb7a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.454614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da496ec0-bf9f-4f44-8a5d-4421d42fcb7a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.517837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da496ec0-bf9f-4f44-8a5d-4421d42fcb7a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.525450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da496ec0-bf9f-4f44-8a5d-4421d42fcb7a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1241 microversion: 2.1 time: 0.093007 Sep 08 14:02:14.525882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 27/54] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:14.764129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:14.765168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:14.774965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.775780 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.776614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.777950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:14.778795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:14.779534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:14.972973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:14.987790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-399d7813-1b8a-4f6d-9eda-e0fd4d79c48f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.235364 Sep 08 14:02:14.988923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 28/55] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:14 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:15.280929 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.282633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.289418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.290695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.291082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.291616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.291758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.292006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.292538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.293047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.298373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.299045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.299709 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.300645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.301105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.301527 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.413369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:15.415725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=99 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:15.422353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1e7393ec-7f74-4dab-8b43-be8651e67970 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.146505 Sep 08 14:02:15.423312 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 28/56] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:15.485831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:15.495034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8013d128-940d-4d62-8641-a6d0ab59b097 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.211291 Sep 08 14:02:15.496040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 29/57] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:15.548990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:15.549499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:15.555726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.556247 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.556683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.557383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:15.557835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:15.558255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:15.627921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:15.636034 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c66f633b-e8c2-40da-b3c7-b33f9cba73b7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1245 microversion: 2.1 time: 0.090957 Sep 08 14:02:15.637284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 29/58] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:15 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:16.013363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.014119 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.021287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.021868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.022500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.023482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.024017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.024563 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.291047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.300532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e58617b6-dede-47ed-b35d-ab7280787079 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.291251 Sep 08 14:02:16.301692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 30/59] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:16.403603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20dfb69d-2dd9-4803-9a84-af1dd315f6c1", "tag": "706e4ad8-bdad-41ff-9794-bc52eb9cf0ff"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:16.450788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.455067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.459685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.464604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.469806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.490637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Creating event network-changed:706e4ad8-bdad-41ff-9794-bc52eb9cf0ff for instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 on hv-cinder-85646 Sep 08 14:02:16.491174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128401) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 14:02:16.491570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9a1d216f-b016-41cc-98d1-434b2ab2715c req-d33275a3-37a8-411f-be5e-c6192c4ac9a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128401) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 14:02:16.493071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.493218 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.493861 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.494445 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.494920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.495269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.496456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.496942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.497381 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.497533 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.498274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.499055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.521831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.compute.rpcapi [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 14:02:16.523062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] Releasing lock "compute-rpcapi-router" {{(pid=128401) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 14:02:16.560598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3b60a9d4-d741-47b2-8c5f-75261ee362d7 None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165068 Sep 08 14:02:16.561845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 30/60] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:16.571309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.571309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.580216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.581292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.582202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.583673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.584771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.585538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.673307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.692766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7627f37d-d5ba-4803-a984-cfa2d82c6361 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.250640 Sep 08 14:02:16.693798 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 31/61] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:16.707354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:16.707354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:16.715100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.716382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.717209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.718718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:16.719647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:16.720446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:16.825886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.840908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-375e3580-965a-42da-8bd5-5e362559c0b0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1245 microversion: 2.1 time: 0.141920 Sep 08 14:02:16.840908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 32/62] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1245 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:16.891754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:16.905074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4cf54cc1-2015-44a7-a456-d7b1b6b58782 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.340491 Sep 08 14:02:16.906649 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 31/63] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:16 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:17.336407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.338796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.350072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.351516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.351833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.353202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.354018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.354876 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.391643 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:17.581357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:17.592077 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1acff770-abed-4d29-907c-cecd90bae218 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.263849 Sep 08 14:02:17.593233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 33/64] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:17.731626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.802120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.802120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.802120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.802120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.802573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.802573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.802573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.819830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:17.833027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bee06cdd-002c-430a-ba17-c0244132d5aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.105855 Sep 08 14:02:17.833610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 32/65] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:17.865978 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.866605 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.873799 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.874292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.874721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.875430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.875883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.876446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.931270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:17.932395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:17.939711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.945659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.946405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.947434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:17.948398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:17.949012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:17.971604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:17.985490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-942ede67-dfba-436b-acfc-6c8bf6fdb1c8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1245 microversion: 2.1 time: 0.123505 Sep 08 14:02:17.986466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 34/66] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:18.202504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:18.202504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3d05bd46-9cfa-47a1-8d14-338a2b6aebcc tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.273274 Sep 08 14:02:18.202504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 33/67] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:17 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:18.616685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:18.617472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:18.624862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.625626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.627994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.629681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.630313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.630902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.828464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:18.840328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7245a6eb-8ee6-4564-8edd-a99f00248d83 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.226110 Sep 08 14:02:18.841536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 35/68] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:18 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:18.877380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:18.877380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:18.894428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.895039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.895585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:18.896718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:18.897375 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:18.897831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.017909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.018485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.027461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:19.032019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.033391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.034231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.035611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.036597 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.037914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.038060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2e83445a-ee2e-4c7d-b0d9-f328c875a8e3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1289 microversion: 2.1 time: 0.174141 Sep 08 14:02:19.039087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 34/69] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:18 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1289 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:19.247784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.250905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.274715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.274715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.274715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.274715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.275028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.275028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.506838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:19.518840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9317fe98-366c-48dc-af1b-d2ecee2b68f7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1245 microversion: 2.1 time: 0.504662 Sep 08 14:02:19.520864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 36/70] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1245 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:19.821418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:19.850094 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6076a308-4fbf-4028-8c79-30963b71948e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.622497 Sep 08 14:02:19.857754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 35/71] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:19.884403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:19.887248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:19.919827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.919827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.919827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:19.919827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:19.920215 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:19.923079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.067073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.068523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.087001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.090030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.090489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.091273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.091739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.092189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.202485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:20.207727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:20.216286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7a12e343-699e-493d-a5bb-3d7742d41b76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.340015 Sep 08 14:02:20.220466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 37/72] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:19 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:20.225873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-468f041b-060c-4ec6-b4b1-b4e194fd3166 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1307 microversion: 2.1 time: 0.154025 Sep 08 14:02:20.226556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 36/73] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:20 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:20.577750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.579932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.586914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.588812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.589622 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.590727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.591412 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.592066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.662988 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:20.671787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7d349217-4a95-48aa-bb6c-8ae6ed484e4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1293 microversion: 2.1 time: 0.107384 Sep 08 14:02:20.672412 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 38/74] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:20 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:20.885639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:20.887791 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:20.903875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.905017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.905806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:20.907310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:20.908175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:20.909276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.115680 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:21.124880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f2d5f439-4ead-45c8-9300-14a668cb1875 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.249077 Sep 08 14:02:21.125465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 37/75] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:20 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:21.248063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:21.248783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:21.255892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.256458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.257007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.257797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.258262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.258747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.259425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:21.260571 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:21.268057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.268695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.269198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.270017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.270586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.271125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.363773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:21.374149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-acb5d7f0-0607-407a-9cb1-296238ad55e0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1295 microversion: 2.1 time: 0.119571 Sep 08 14:02:21.374750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 38/76] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:21 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:21.452351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:21.467277 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e9d725ed-6677-44ab-bdb1-35f6bbe52807 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.223648 Sep 08 14:02:21.468448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 39/77] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:21 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:21.708552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:21.709332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:21.716454 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.716947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.717384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.718105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:21.718562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:21.718995 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:21.796740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:21.796740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f2426a99-1dba-4205-a23b-345bced16731 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1293 microversion: 2.1 time: 0.091793 Sep 08 14:02:21.797121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 39/78] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:21 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:22.163943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:22.174427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:22.190044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:22.190927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=14 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:22.197416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.198259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.198904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.200443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.201392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.202519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.398801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:22.399465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:22.421319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.423110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.423839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.425852 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.427270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.428366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.560170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.571870 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-303a7f1d-aa39-4c92-b10d-45e088548057 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.418445 Sep 08 14:02:22.572504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 40/79] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:22 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:22.584937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:22.589679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:22.602841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.605750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.606457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.607196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.607802 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.610967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.789424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.798221 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-31acee20-5e7f-49fc-b8ea-1584a9bf248c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.404021 Sep 08 14:02:22.799015 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 40/80] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:22 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:22.827650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:22.828529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:22.837384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.838274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.838898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.844952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:22.844952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:22.844952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:22.873290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.895019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fe36f2d5-1a7a-4567-a795-339009375ba4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.314853 Sep 08 14:02:22.897715 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 41/81] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:22 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:22.955874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:22.964773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ad1e5fe4-0da4-4d61-8022-9df43d243854 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1293 microversion: 2.1 time: 0.146020 Sep 08 14:02:22.966159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 41/82] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:22 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:23.613969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:23.623785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:23.632377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.633200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.633780 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.634829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.635649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.636237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.824105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:23.833129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-93b0e3ea-b428-4df9-a4ca-9412c4c76a2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.223788 Sep 08 14:02:23.844186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:23.844186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:23.845500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 42/83] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:23 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:23.851303 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.852441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.853372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.854106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.854672 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.855110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.925091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:23.926174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:23.953164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.953982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.954807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:23.955819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:23.956640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:23.957657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.022194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:24.034920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f19ac6cd-173a-4084-b7be-490eda46f6f4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.201333 Sep 08 14:02:24.048682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 42/84] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:23 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:24.052621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:24.053554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:24.069252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.069855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.070426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.071380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.071899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.072653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.188108 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:24.202011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0f96d484-7049-4e15-ba75-16d27d066863 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1301 microversion: 2.1 time: 0.165400 Sep 08 14:02:24.203013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 43/85] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:24 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1301 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:24.208022 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fec36d5-04f6-46ec-8406-004966e4e97b", "tag": "dee806ed-287f-4f49-b833-092647ad43ff"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:24.219080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.219968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.219968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.233963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] Creating event network-changed:dee806ed-287f-4f49-b833-092647ad43ff for instance 7fec36d5-04f6-46ec-8406-004966e4e97b on hv-cinder-85646 Sep 08 14:02:24.239531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-25eca999-8813-440b-bf47-a67ad6180cf1 req-0233017b-cb6b-4443-a2b6-f64878cf44f5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035141 Sep 08 14:02:24.240086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 44/86] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:24.263990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:24.282010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8da1e5ab-4b62-4fad-95d8-dcb0378e2d9d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.363708 Sep 08 14:02:24.284299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 43/87] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:23 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:24.858247 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:24.863421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:24.864637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:24.872126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.873032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.873530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:24.874439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:24.875073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:24.875691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.038359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.048928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-701e67d5-637e-47d6-98f3-c6403030bae8 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.191048 Sep 08 14:02:25.053359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 45/88] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:24 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:25.074156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:25.076018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.084262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.085364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.086328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.087710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.088787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.090243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.240783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:25.241601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.242856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.249117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.249986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.250526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.251133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-867876ee-8199-42cd-b281-acd47bde439c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.182421 Sep 08 14:02:25.251446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.251794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 44/89] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:25 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:25.252120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.252770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.273652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:25.307362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:25.308672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:25.323968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.325415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.326083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.326997 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:25.327664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:25.333116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:25.343023 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.355406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2d1e5ba6-f0a6-4658-97d1-4e94778e3535 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1301 microversion: 2.1 time: 0.118793 Sep 08 14:02:25.357862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 46/90] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:25 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1301 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:25.522465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:25.532638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c42b10f8-2d29-47d4-b085-ce5fd3d63e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.229681 Sep 08 14:02:25.533237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 45/91] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:25 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:26.077543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.085691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.108619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.111546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.112690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.118320 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.118880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.119688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.287681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.288525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.297833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.298393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.299039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.299804 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.300482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.301101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.397790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.408175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1fa084b6-b432-44d0-a84e-8544c33e5f3c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.338183 Sep 08 14:02:26.422691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 47/92] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:26.439788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.440769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.458238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.458425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.458712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.459593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.460011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.460489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.516232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:26.590804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.600052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-91f1541e-0f50-4594-93b2-0a784c8720cb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1299 microversion: 2.1 time: 0.175725 Sep 08 14:02:26.604595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 48/93] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:26.610796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.619596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:26.620236 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:26.627562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.628443 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.628885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.629613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:26.630068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:26.630491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:26.653272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-49b70ca9-4c8e-4556-b147-1231f79d8fe7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.368625 Sep 08 14:02:26.660874 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 46/94] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:26.833756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:26.843197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2aecd1ea-580b-4a7d-8186-2f0ef457b066 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.236464 Sep 08 14:02:26.843894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 49/95] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:26 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:27.442217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.449016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.483558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.485590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.486045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.489428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.489428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.489428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.658511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.661738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.683796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.684509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.685162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.686053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.686926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.687564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.841525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:27.849131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:27.850413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-424a2dfc-d1d4-4cf9-a2c3-573085721e19 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.414972 Sep 08 14:02:27.865851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 47/96] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:27.875422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.876439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.882955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.883753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.884303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.885638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c512e06c-5db9-400b-a02b-bb79ca829881 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1299 microversion: 2.1 time: 0.234750 Sep 08 14:02:27.885918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.887138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.887735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.888299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 50/97] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:27.920802 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:27.922329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:27.946434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.946948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.947394 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:27.948832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:27.948832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:27.949763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.282671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:28.291368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6f1fac3f-227c-4631-98f2-69ce50ea0e01 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.392045 Sep 08 14:02:28.292762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 51/98] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:28.321085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:28.341683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a62b5037-89b2-42c9-b717-167e2a323c3f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.468075 Sep 08 14:02:28.341683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 48/99] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:27 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:28.795539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef13e6e-be3d-4cf5-977c-08a0521e5190", "name": "network-vif-plugged", "status": "completed", "tag": "a1b41d99-de62-4f6e-bc67-196b31315976"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:28.805431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.810195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.810195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.825485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] Creating event network-vif-plugged:a1b41d99-de62-4f6e-bc67-196b31315976 for instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 on hv-cinder-85646 Sep 08 14:02:28.833303 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-912bd398-4b17-4d79-9a3a-98ac51a52576 req-4800f09b-eb04-4226-a857-4a600595262b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368790 Sep 08 14:02:28.834057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 52/100] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:28.886996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:28.891539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:28.903803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.909065 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.909931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.911818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.912914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.914225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.948179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:28.952123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:28.980647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.981770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.982684 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:28.983921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:28.987614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:28.988390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.420609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.431339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.453329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ad3e40ec-1d29-4089-820c-1e3313c7c3c1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.510507 Sep 08 14:02:29.453579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a8ab7e4a-ed63-4bd3-858c-c5b8b167f32e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.567460 Sep 08 14:02:29.453579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 49/101] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:28 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:29.453815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 53/102] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:28 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:29.453946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:29.460189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:29.460189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:29.460750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:29.472185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.474341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.475239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.475942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.476990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.477460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.478259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.481819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.482768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:29.484040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.485736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:29.486670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:29.487611 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:29.752537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.760986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fd1b9c14-9773-427e-8d14-11a34305d51d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.313272 Sep 08 14:02:29.764437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:29.770813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 50/103] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:29 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:29.777020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f75973d7-0da6-43d2-8784-20cca3e995ce tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.327464 Sep 08 14:02:29.777815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 54/104] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:29 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:30.475095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.476916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.493326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.493326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.493326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.494073 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.494546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.495279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.499330 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.500656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.526426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.528044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.531546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.533367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.534371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.538344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.865646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:30.883928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:30.893114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6064885a-a65f-4917-b862-6bdc9618cda7 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.423558 Sep 08 14:02:30.894448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 51/105] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:30.900967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff597ca-3f06-47d9-92c0-b3fc4522c030", "tag": "60d1c9d8-da7e-445b-9122-c37ad4ef2e1a"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:30.912279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.912763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.916608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.916836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9ffe32b7-a65b-4330-b634-ce4a8c67554d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.434653 Sep 08 14:02:30.916836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 55/106] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:30.926448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] Creating event network-changed:60d1c9d8-da7e-445b-9122-c37ad4ef2e1a for instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 on hv-cinder-85646 Sep 08 14:02:30.927940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.928609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.932418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-bf31eb43-f8a5-4880-9d05-94743097d954 req-31587500-7a01-4855-8ff9-56682784e2f3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036332 Sep 08 14:02:30.933231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 52/107] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:30.943172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.943669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.946281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.947202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:30.947479 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.948959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:30.951043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.951672 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.965726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.966450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.967388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:30.969603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:30.971110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:30.971889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.367941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:31.368201 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:31.377208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-be8e821a-138c-49f3-af85-2ef7e45a54c5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.438875 Sep 08 14:02:31.377809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 53/108] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:31.395540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ec744cac-2dfd-4004-beba-041085dbf3bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.477249 Sep 08 14:02:31.396236 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 56/109] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:30 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:31.933877 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:31.934692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:31.943746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.944434 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.945084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.946047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.946756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.947507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.980609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:31.980609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:31.980609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.980609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.981930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:31.981930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:31.981930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:31.981930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.213825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:32.230284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-57b3acaa-8a02-437f-baf6-a32e3790391c tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.300572 Sep 08 14:02:32.232612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 54/110] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:31 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:32.259640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:32.269898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c053001a-b533-4905-8622-ba3164266df6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.310911 Sep 08 14:02:32.271708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 57/111] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:31 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:32.410481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:32.411124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:32.418984 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.419275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:32.419641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.420042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.420820 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.421177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:32.421297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.421775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.429840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.430522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.431274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.432948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:32.434629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:32.434991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:32.704722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:32.708301 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:32.720425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-013204b1-e9f7-49cb-b267-7be6d5cb211e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.305290 Sep 08 14:02:32.725102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 58/112] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:32 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:32.725323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d73e6ce8-4078-4ee9-ad55-e11dda250868 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.315149 Sep 08 14:02:32.725323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 55/113] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:32 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:33.263746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:33.264643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:33.279038 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.280449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.281049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.282651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.283376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.283997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.330611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:33.337511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:33.349464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.350759 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.351696 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.353450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.354812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.356497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.592276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:33.612951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ffa2b101-406e-4e24-9370-54def063f850 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.353852 Sep 08 14:02:33.618364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 59/114] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:33 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:33.641813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:33.656511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-69da70b7-3c99-44cd-a51c-e7052ebf20a3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.348015 Sep 08 14:02:33.657161 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 56/115] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:33 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:33.751869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:33.752799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:33.760955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.761480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.762078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.762869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.763445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.764287 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.768271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:33.768904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:33.788536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.789053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.789489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:33.790225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:33.790683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:33.796083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.127978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:34.139493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-14303946-d4f1-48c4-a6eb-ec5b12ba9ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.394719 Sep 08 14:02:34.140428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 60/116] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:33 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:34.150317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:34.163146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ae329ae9-221d-461d-b8e9-0e1479b4981d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.405911 Sep 08 14:02:34.163858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 57/117] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:33 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:34.657985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:34.658609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:34.666091 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.666969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.667577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.669666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.670366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.670941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.694209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:34.696460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:34.710094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.711403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.717884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:34.717884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:34.717884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:34.717884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.090722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:35.102946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-aed2bd53-a27d-4ecd-8318-c9096c278800 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.448219 Sep 08 14:02:35.113404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 61/118] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:34 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:35.154286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:35.164954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:35.166594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:35.170147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-01af8d71-ae95-46e7-b037-397e781147fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.483397 Sep 08 14:02:35.172008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 58/119] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:34 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:35.198733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:35.199800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:35.206445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.207015 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.207383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.208114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.208599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.209025 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.214401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.216261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.218713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.220900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:35.222358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:35.225601 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:35.619830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:35.633888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3fd70059-5d73-423b-ad26-fcfce211bb66 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.451026 Sep 08 14:02:35.635084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 59/120] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:35 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:35.639300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:35.648219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-99f66a18-6d49-4b91-b9c4-22b7aaab15ac tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.488280 Sep 08 14:02:35.669966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 62/121] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:35 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:36.161109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:36.162219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:36.170195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.170977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.171737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.172845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.173672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.174425 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.200675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:36.203309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:36.214368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.215532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.216091 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.220324 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.221568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.225173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.383550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:36.399927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-51ffc9dc-535b-4568-9fe6-aff4fcac70cf tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.249443 Sep 08 14:02:36.401998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 60/122] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:36 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:36.477586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:36.481351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:36.492651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ddf636ed-e6b7-4242-84d1-2b1684a70e72 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.298230 Sep 08 14:02:36.493848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 63/123] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:36 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:36.661769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:36.662379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:36.669000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.669496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.669930 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.670648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.671098 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.671516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.685571 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:36.686417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:36.697863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.697863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.697863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.697863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:36.698380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:36.698380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:36.941756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:36.964370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3e6aed0a-cb1f-483f-a17e-57d9b22aa9a3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.297911 Sep 08 14:02:36.964370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 61/124] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:36 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:36.980741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:36.991847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-381350de-d693-4b2f-ad0a-fee769e881a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.310134 Sep 08 14:02:36.993237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 64/125] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:36 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:37.430398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:37.431593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:37.442661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.443496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.444285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.445283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.445854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.446512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.527684 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:37.529383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:37.540478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.541208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.542065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.543223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:37.543886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:37.544701 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:37.975309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:37.985891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-914c5755-6276-4a74-bc1c-b36ad2308c75 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.563409 Sep 08 14:02:37.986511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 62/126] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:37 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:37.992270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:37.993227 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:38.010030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.010030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.010030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.010030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.010778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.010778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.030086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.042227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-076b975b-20b1-40a6-ba9f-a917229912bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.523689 Sep 08 14:02:38.043401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 65/127] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:37 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:38.049359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:38.050573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:38.058095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.058788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.059689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.060951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:38.061903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:38.062937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:38.283272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.289769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:38.307054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c436eac0-6e5a-4082-b3ab-2c56761719fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.318990 Sep 08 14:02:38.310595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 63/128] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:37 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:38.347256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f0e05b30-f18b-4342-8d33-03732f67daa3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.284267 Sep 08 14:02:38.347256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 66/129] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:38 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.018882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.019520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.026281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.026809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.027327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.032064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.032064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.032064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.083161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.085529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.098828 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.099425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.100097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.101244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.101975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.102949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.253357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.263309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d2979218-5959-4752-a627-d466ba017ce5 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.247981 Sep 08 14:02:39.264246 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 64/130] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.296271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.304666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-15cbf1a3-862f-40ce-bd41-533b78068063 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.227331 Sep 08 14:02:39.305255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 67/131] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:39.358485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.358485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.358485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.358848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:39.359135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.360361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.360484 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:39.360636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.361469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.362234 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.366676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.367982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.368708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.369539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.370105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.370625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.584515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.597386 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-86883685-50d5-48c8-8775-38420f66ff46 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.248153 Sep 08 14:02:39.598535 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 68/132] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.603432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:39.613034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cc079794-9c6b-4836-ba82-0572b5fa0180 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.269817 Sep 08 14:02:39.613831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 65/133] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:39 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:39.890318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ce34a4-1425-461c-a3f2-9c33ee80711a", "name": "network-vif-plugged", "status": "completed", "tag": "2be35524-3109-4419-9c9d-3db11f8850f7"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:39.908883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:39.909714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:39.910479 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:39.934030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] Creating event network-vif-plugged:2be35524-3109-4419-9c9d-3db11f8850f7 for instance f5ce34a4-1425-461c-a3f2-9c33ee80711a on hv-cinder-85646 Sep 08 14:02:39.942944 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-34a66bdc-837d-43c8-8cb1-7de0e2d8bc8c req-9df501a5-6c63-4857-9624-c56a5db2ed2b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061303 Sep 08 14:02:39.944686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 69/134] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:40.288098 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.288931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.298704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.299206 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.299649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.300426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.300899 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.301339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.333131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.334497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.344938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:40.347840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.348718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.349455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.350706 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.351885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.352679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.550256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:40.561231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8b5010f3-14a5-45fb-baf6-88e649d5aab4 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.277208 Sep 08 14:02:40.561982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 66/135] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:40.633642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.634090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:40.634771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.646343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-268f3fdb-b93d-4b48-ae1d-9f2b78a2e280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.321048 Sep 08 14:02:40.648761 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 70/136] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:40.649258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.649985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.650673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.651636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.653469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.654135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.655775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:40.656428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:40.686275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.687538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:40.687674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.688097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:40.693399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:40.694288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:40.695356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.034359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:41.054735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:41.058428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a825e088-b2f3-4c07-8a09-4e50e9eff9cd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.427951 Sep 08 14:02:41.062440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 67/137] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:41.068505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-93b0312b-2b44-4b92-826b-a266eed73f98 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.417469 Sep 08 14:02:41.069530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 71/138] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:40 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:41.592106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:41.593268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:41.610481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.613618 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.615524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.619713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.621626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.628591 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.688847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:41.693093 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:41.710016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.711485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.712166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:41.713475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:41.714031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:41.714668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.035501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.049650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-156f4b77-5223-40f8-ab32-ac114fc5059d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1315 microversion: 2.1 time: 0.462914 Sep 08 14:02:42.050679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 68/139] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:41 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.064851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20dfb69d-2dd9-4803-9a84-af1dd315f6c1", "name": "network-vif-plugged", "status": "completed", "tag": "706e4ad8-bdad-41ff-9794-bc52eb9cf0ff"}, {"server_uuid": "7fec36d5-04f6-46ec-8406-004966e4e97b", "name": "network-vif-plugged", "status": "completed", "tag": "dee806ed-287f-4f49-b833-092647ad43ff"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:42.082310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.083054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.084030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.102780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.104880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Creating event network-vif-plugged:706e4ad8-bdad-41ff-9794-bc52eb9cf0ff for instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 on hv-cinder-85646 Sep 08 14:02:42.105794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] Creating event network-vif-plugged:dee806ed-287f-4f49-b833-092647ad43ff for instance 7fec36d5-04f6-46ec-8406-004966e4e97b on hv-cinder-85646 Sep 08 14:02:42.117764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-971debf0-3a87-4980-a74b-370043d03f4e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.436260 Sep 08 14:02:42.117957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-98295a18-c8dd-4212-9e17-b2ee1d508afe req-b4d96be1-ee15-428e-96a3-8b253804e849 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064318 Sep 08 14:02:42.129504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 72/140] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:41 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.130028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 69/141] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:42.130028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:42.130028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:42.131310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:42.133159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:42.142776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.144317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.145586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.146895 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.147843 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.148594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.153308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.154416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.155174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.155971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:42.156472 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:42.156906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:42.486010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.498133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-54173278-2622-4643-af17-4acee889256c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.377555 Sep 08 14:02:42.498283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:42.499026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 70/142] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:42 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:42.515068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-39d2adcb-60ca-4fc7-ae04-a1d117aa34e3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.390332 Sep 08 14:02:42.515068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 73/143] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:42 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:43.104661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.106959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.119842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.121447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.122901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.125055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.127203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.128379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.159686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.160886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.188906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.189769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.190590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.191877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.192711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.193699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.547981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:43.588001 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-32567a84-84ba-49b0-abd2-992e4edd289d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1501 microversion: 2.1 time: 0.505495 Sep 08 14:02:43.589480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 71/144] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:43.603185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.606168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.622149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.623613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.624905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.626821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.629426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.630497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.659907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:43.677258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c48fc8a5-1cd3-462c-b6bf-599cbf85a76b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.527589 Sep 08 14:02:43.692650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 74/145] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:43.719273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:43.720724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:43.757322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.758618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.759927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:43.763655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:43.764888 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:43.777813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.015442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.029516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-68ce3582-883b-4d45-bbb7-7c0205856e06 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.436859 Sep 08 14:02:44.030916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 72/146] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:44.060134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.084799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9a76fbef-2702-4d29-9109-c1d9a03bae3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.390413 Sep 08 14:02:44.085558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 75/147] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:43 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:44.726622 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:44.727890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:44.735334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:44.735821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:44.736511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.737436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:44.737894 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:44.738335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:44.946452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:44.954627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-88ede4ef-5d23-4db6-a26c-0e8221cc7e2b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.232098 Sep 08 14:02:44.955201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 73/148] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:44 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:45.058360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.059106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.065813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.069210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.069210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.069210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.069210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.069519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.116828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.117380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.124302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.124782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.132703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.132703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.132703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.132703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.491499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:45.507609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-54408309-4b25-4385-a68d-d9e2e0a0a6af tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1362 microversion: 2.1 time: 0.453516 Sep 08 14:02:45.524106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:45.526172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 76/149] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:45.544575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-875bb3b8-fa34-4fff-9c5b-4a48a87b19c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1322 microversion: 2.1 time: 0.434182 Sep 08 14:02:45.545639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 74/150] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:45.907674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "899373e1-6f71-4587-b834-3641bbca7297"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:45.912134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:45.925940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.926983 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.927937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.928984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:45.931113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:45.932081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:45.987191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:45.990051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.004887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.006513 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.007320 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.010488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.013352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.015359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.290871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:46.301743 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c7925083-04a6-451c-9ba1-4e5d8ba9530f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.326283 Sep 08 14:02:46.305176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 75/151] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:45 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:46.321447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff597ca-3f06-47d9-92c0-b3fc4522c030", "name": "network-vif-plugged", "status": "completed", "tag": "60d1c9d8-da7e-445b-9122-c37ad4ef2e1a"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:46.339301 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:46.345826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.345826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.345826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.376097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] Creating event network-vif-plugged:60d1c9d8-da7e-445b-9122-c37ad4ef2e1a for instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 on hv-cinder-85646 Sep 08 14:02:46.387179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-4c53c8a0-22c4-4b29-bb6f-54093df0ff8a req-740949d4-a357-48eb-8763-9c3758feee84 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082292 Sep 08 14:02:46.389396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 76/152] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:46.551914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.552837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.561543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.562187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.562710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.563840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.564702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.565525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.848253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:46.861488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ea6697e6-3d2a-4522-b0dd-d9ecd63bc3d6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1549 microversion: 2.1 time: 0.314672 Sep 08 14:02:46.878501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 77/153] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1549 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:46.889325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:46.889961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:46.896664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.897223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.897667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:46.898901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:46.899384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:46.899824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.151141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:47.161631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-be6c8ec7-c439-4bae-8e32-1b66097abdba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1516 microversion: 2.1 time: 0.281823 Sep 08 14:02:47.162894 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 78/154] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:46 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:47.169181 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:47.175948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.175948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.176606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.177389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.177919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.178625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.179254 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.364733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e5a9c09b-f637-428b-a51f-c288a8e969b6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200227 Sep 08 14:02:47.366436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 79/155] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:02:47 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:47.378635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:47.383004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.396497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.397376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.398145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.399495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.400355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.401130 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.449739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'flavor' on Instance uuid 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:02:47.568934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fc562cf0-c2ec-4203-8630-a2cc8cc2fd8b tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "POST /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.664800 Sep 08 14:02:47.571288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 77/156] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:02:45 2022] POST /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a/os-volume_attachments => generated 194 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:47.620358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:47.624241 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:47.634294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.635891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.637216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.638273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:47.638997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:47.639501 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:47.965150 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:47.998099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3276dab7-0f4f-4338-bc31-c4f8b908878a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1367 microversion: 2.1 time: 0.423258 Sep 08 14:02:48.002592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 78/157] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:47 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:48.070042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f26be2ed-16e8-43be-8149-772ed2dd58e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1/action" status: 200 len: 32 microversion: 2.1 time: 0.701245 Sep 08 14:02:48.070848 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 80/158] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:02:47 2022] POST /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1/action => generated 32 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:02:48.081564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:48.082190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:48.089137 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.089441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.090742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.091643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:48.092280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:48.092866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:48.636230 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:48.644063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:48.654593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-abe0a7f6-c633-4bd3-87ac-d9ee89067eba tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.577326 Sep 08 14:02:48.655211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 79/159] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:48 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:49.043218 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:49.044538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:49.064094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.064094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.064094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.064094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.064687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.064687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.418147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:49.428750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3dffb525-8427-419b-ad29-5a1ead7b7214 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1556 microversion: 2.1 time: 0.391202 Sep 08 14:02:49.452540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 81/160] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:49 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1556 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:49.476382 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:49.476954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:49.486514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.487008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.487702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.488656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.601862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.601862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.632568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a945ee51-90cc-42a1-8391-4618f60dbd13 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159792 Sep 08 14:02:49.634139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 80/161] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:02:49 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:49.691825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:49.691825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:49.691825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.691825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.692308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.692308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:49.692308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:49.692308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:49.968355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:49.977746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bab7f0b8-011e-4c5a-a158-06c8570f9302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.300791 Sep 08 14:02:49.992308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 82/162] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:49 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:50.206229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fec36d5-04f6-46ec-8406-004966e4e97b", "tag": "dee806ed-287f-4f49-b833-092647ad43ff"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:50.238242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:50.239642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:50.240668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:50.276358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] Creating event network-changed:dee806ed-287f-4f49-b833-092647ad43ff for instance 7fec36d5-04f6-46ec-8406-004966e4e97b on hv-cinder-85646 Sep 08 14:02:50.291874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-44e469d7-f92a-408a-9b6b-2aa6fa28a41b req-cd5beeb9-95fc-44d4-96eb-a50feb4c1695 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184836 Sep 08 14:02:50.295267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 81/163] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:02:51.003325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:51.004747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:51.023159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.023926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.025555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.031257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:51.038933 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:51.040621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:51.321883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:51.326386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:51.331702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5e40fe7a-523a-4e06-8024-e4005479bcd9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.333208 Sep 08 14:02:51.332611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 83/164] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:50 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:52.360619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:52.362064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:52.369882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.370639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.371160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.372050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.372555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.372988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.606836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:52.615846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5b239417-c51c-4c4b-ac09-2c0ec6ac9e3b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.263700 Sep 08 14:02:52.628656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 82/165] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:52 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:02:52.631584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff597ca-3f06-47d9-92c0-b3fc4522c030", "tag": "60d1c9d8-da7e-445b-9122-c37ad4ef2e1a"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:02:52.643273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:52.643758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:52.644326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:52.668576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] Creating event network-changed:60d1c9d8-da7e-445b-9122-c37ad4ef2e1a for instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 on hv-cinder-85646 Sep 08 14:02:52.668576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-40459435-4cb9-42d9-b52b-cf4102a40359 req-4a1d3783-5383-4da1-8e8c-8c96b8dc281f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036896 Sep 08 14:02:52.668576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 84/166] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:02:53.650357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:53.656352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:53.663365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.664182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.664855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.666006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:53.667014 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:53.668584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:53.891736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:53.904813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3f750858-e5fd-426b-ab86-97b0cb1e1c27 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.263782 Sep 08 14:02:53.906492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 83/167] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:53 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:54.930669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:54.931659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:54.939956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:54.940482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:54.940907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:54.941640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:54.942088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:54.942507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:55.112517 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:55.122262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3d423191-e400-4ac5-addd-62124e80723e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.195997 Sep 08 14:02:55.123063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 85/168] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:54 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:56.147306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:56.147882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:56.154851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.155342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.155786 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.156536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:56.157045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:56.157479 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:56.299718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:56.309284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-454686ae-f9a4-43db-9345-761eb21822b6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.166206 Sep 08 14:02:56.326543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 84/169] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:56 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:57.334754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:57.335373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:57.342658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:57.343047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:57.343580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:57.344200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:57.344700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:57.345185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:57.485580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:57.499447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-59330859-3058-472e-ae4b-671001642df0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.168714 Sep 08 14:02:57.500321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 86/170] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:57 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:58.522145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:58.522898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:58.530808 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.531347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.531801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.532650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:58.533144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:58.533766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:58.721993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:02:58.738965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-99a27332-b641-4f72-a630-b7a565f5b05d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.220348 Sep 08 14:02:58.739989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 85/171] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:58 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:02:59.775657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:02:59.776365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:02:59.783611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.784290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.784838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.785693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:02:59.786380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:02:59.787196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:02:59.993383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:00.004537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-008d949b-7cde-43aa-971a-89815d9e1184 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.234807 Sep 08 14:03:00.005324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 87/172] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:02:59 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:01.029422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:01.030044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:01.036923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.037401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.037831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.038536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:01.038988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:01.039410 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:01.197377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:01.210760 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5939c170-378c-4adc-b945-8af2d542af69 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.185099 Sep 08 14:03:01.211782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 86/173] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:01 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:02.237845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:02.238472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:02.245076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:02.245590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:02.246642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.247390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:02.247923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:02.248450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:02.424625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:02.434162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-abc13d1c-78c9-4764-a99b-903fef2a2e70 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.199442 Sep 08 14:03:02.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 88/174] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:02 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:03.461857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:03.462647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:03.470786 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.475290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.475290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.475290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:03.475290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:03.475979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:03.644280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:03.661884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5abf10a6-a090-4f71-ba51-f6ccf27f61f6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.204552 Sep 08 14:03:03.662787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 87/175] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:03 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:04.688122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:04.688868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:04.696172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.696686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.697186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.698338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:04.699617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:04.700381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:04.864168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:04.873050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5bcf7888-3455-47e6-9a9b-dae69d00abdd tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.189826 Sep 08 14:03:04.873721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 89/176] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:04 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:05.261716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.263317 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.278885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.278885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.278885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.278885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.279577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.279577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.326080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:03:05.826451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e03c5c2c-287a-4460-af75-be54b56b34fe tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 204 len: 0 microversion: 2.1 time: 0.572846 Sep 08 14:03:05.827588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 88/177] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:05 2022] DELETE /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:03:05.836971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.837794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.844458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.845214 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.845706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.846422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.846880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.847325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.905389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:05.906172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:05.912813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.913299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.913750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:05.914461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:05.914909 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:05.915331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:06.099741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:06.124866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ebaa2d1d-00bd-4b5b-861b-f0c139bb61c3 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1553 microversion: 2.1 time: 0.276964 Sep 08 14:03:06.124866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 90/178] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:05 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:06.134669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:06.145908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c61f018f-cd86-4e8a-9e0f-d0ab31a827d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.244539 Sep 08 14:03:06.146727 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 89/179] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:05 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:07.134866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:07.137635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:07.144176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.144873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.145307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.146016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.146468 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.147060 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.185666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:07.186834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:07.199519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.200470 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.201212 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.202673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:07.203525 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:07.204357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:07.389054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.399873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1ee1c393-511f-4ec1-be7f-a883220dc259 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1553 microversion: 2.1 time: 0.269893 Sep 08 14:03:07.400864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 91/180] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:07 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:07.483152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:07.523595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-62623e56-aeca-47ad-8411-8eba0a9d45c5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.344065 Sep 08 14:03:07.532120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 90/181] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:07 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:08.444232 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.445471 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.457471 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.458885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.459925 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.464070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.465264 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.466082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.552221 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:08.555440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:08.562683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.563544 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.563671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.565842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:08.566358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:08.566803 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:08.712629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.729818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5283b667-a442-4fb5-bd38-8ad58674cd78 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1553 microversion: 2.1 time: 0.293977 Sep 08 14:03:08.754913 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 92/182] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:08.771988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:08.787845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-80244567-1017-4f39-bf75-435986e3df0d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.242169 Sep 08 14:03:08.789457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 91/183] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:08 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:09.760735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.761870 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.768965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.769457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.769879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.770648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.771395 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.771828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.824759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:09.825834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:09.834491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.834990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.835500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:09.836215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:09.836849 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:09.837426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.052842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.060382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-344d08b8-e8f6-4b59-823e-09e911f47d2d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1553 microversion: 2.1 time: 0.302733 Sep 08 14:03:10.060617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 93/184] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:10.095968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ce34a4-1425-461c-a3f2-9c33ee80711a", "name": "network-vif-deleted", "tag": "2be35524-3109-4419-9c9d-3db11f8850f7"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:10.154492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:10.157336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:10.157336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.220627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] Creating event network-vif-deleted:2be35524-3109-4419-9c9d-3db11f8850f7 for instance f5ce34a4-1425-461c-a3f2-9c33ee80711a on hv-cinder-85646 Sep 08 14:03:10.235890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-c642245a-ba68-4af3-8e92-d17c80e0fa1d req-42a868dc-7d0d-4845-8c8f-ebfd4d0458c8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156352 Sep 08 14:03:10.244537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 94/185] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:10.295939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:10.304913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-42a4dd59-e0e6-44ea-ad8b-52c662752bd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.487018 Sep 08 14:03:10.306190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 92/186] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:09 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:11.085756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.086463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.093638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.097693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.097693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.097693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.097693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.098078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.176199 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.187763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7a301bc6-450a-49ed-9f09-53b649cab280 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1346 microversion: 2.1 time: 0.106678 Sep 08 14:03:11.188481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 95/187] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:11.345429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:11.346213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:11.353435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.354203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.354655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.355401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.355862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.356330 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.540704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:11.555560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ba43541c-0d78-4409-9561-6b14332e4e95 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.213616 Sep 08 14:03:11.556676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 93/188] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:11 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:12.214298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.215008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.221399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.221859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.222284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.222977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.223429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.223848 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.258700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.259184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.259614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.260063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lazy-loading 'fault' on Instance uuid f5ce34a4-1425-461c-a3f2-9c33ee80711a {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:12.318766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.333904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2080de44-adba-4221-8f56-a72d175c6e1e tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1351 microversion: 2.1 time: 0.124260 Sep 08 14:03:12.335061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 96/189] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:12.594155 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:12.594804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:12.597339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:12.603549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.604165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.604671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.606246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:12.606780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:12.607256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:12.768036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:12.776104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b67989fb-36b8-46b0-9c0e-038374b75def tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.186206 Sep 08 14:03:12.776733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 94/190] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:12 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:13.377202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.378159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.384361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.384931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.387953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.387953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.387953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.387953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.430681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.431170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.431610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.432059 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lazy-loading 'fault' on Instance uuid f5ce34a4-1425-461c-a3f2-9c33ee80711a {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:13.486342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.497083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c70ecb6c-4a7a-4ef5-8d49-8956151b0f23 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1351 microversion: 2.1 time: 0.123780 Sep 08 14:03:13.497677 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 97/191] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:13 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:13.800119 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.800764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.818823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.818823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.818823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.818823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.827425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.827425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.986439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:13.990279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:13.997777 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8cf737f1-9915-4243-b050-2da26935ba02 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.201690 Sep 08 14:03:13.999487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 95/192] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:13 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:14.536489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.537162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.543904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.544456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.544893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.545682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.546139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.546561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.583010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.583414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.583844 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.584332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lazy-loading 'fault' on Instance uuid f5ce34a4-1425-461c-a3f2-9c33ee80711a {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:14.631832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96336eb4bfd461e82e7761077a5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcfe1ebb994061b6d203510fd7e65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:14.641396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-adeccf8b-7646-43d1-8ab8-f3a50d84ef4d tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 200 len: 1351 microversion: 2.1 time: 0.109003 Sep 08 14:03:14.641990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 98/193] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:15.023967 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.024661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.033874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.034368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.034862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.035836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.036117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.036572 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.237546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:15.256640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-76dbce54-be1b-40cc-8d55-3866cdcb372d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.231518 Sep 08 14:03:15.256640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 96/194] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:15.665275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.666094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.672736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.673331 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.673883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.675238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.675698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.676122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.691465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] HTTP exception thrown: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Request method failure captured: Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a HTTP/1.1 Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXOr62TiY9diCsXsBTdQNqLtuw9n60zb6dAUK0hLET-ek0sphnh9fCf-iRQjdwRoDpueuvkBYnt_DzgcqwuTKKvYYml2aWHRigekyM30PXKu6kDR-zxV4aZ54SE5SFNFaiKjkzAKNXsXcxSrWIE78niQu2l_KJaz74_IbG4DurjD-I Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:03:15.696654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9cfcfe1ebb994061b6d203510fd7e65b", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c96336eb4bfd461e82e7761077a5b910 Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.698658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f5ce34a4-1425-461c-a3f2-9c33ee80711a'} Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:15.700983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.704719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.706702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Returning 404 to user: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:15.706702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a81c0540-0394-40f4-bee9-28c01b116d5f tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 404 len: 111 microversion: 2.1 time: 0.037298 Sep 08 14:03:15.706702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 99/195] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:15.909518 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.912254 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.920976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.922044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.922756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.924024 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.924765 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.925216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.942646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] HTTP exception thrown: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Request method failure captured: Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a/os-volume_attachments HTTP/1.1 Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXOr62TiY9diCsXsBTdQNqLtuw9n60zb6dAUK0hLET-ek0sphnh9fCf-iRQjdwRoDpueuvkBYnt_DzgcqwuTKKvYYml2aWHRigekyM30PXKu6kDR-zxV4aZ54SE5SFNFaiKjkzAKNXsXcxSrWIE78niQu2l_KJaz74_IbG4DurjD-I Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:03:15.948117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9cfcfe1ebb994061b6d203510fd7e65b", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c96336eb4bfd461e82e7761077a5b910 Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.950199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'server_id': 'f5ce34a4-1425-461c-a3f2-9c33ee80711a'} Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:15.951047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:15.952455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:15.953853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Returning 404 to user: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:15.953853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8e36c512-6f90-4f0d-9377-4a889110b9f2 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046811 Sep 08 14:03:15.954196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 97/196] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:03:16.277647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.278270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.285163 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.286327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.286802 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.287558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.288019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.288481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.501941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:16.516976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-78adfb83-7a81-48eb-a9c9-eba7500226f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.243041 Sep 08 14:03:16.521310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 100/197] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:16 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:17.557159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.558399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.577985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.577985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.577985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.577985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.578555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.578555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.587205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.592410 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.599834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.604985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.604985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.604985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.604985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.606162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.629026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] HTTP exception thrown: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Request method failure captured: Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a HTTP/1.1 Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXOr62TiY9diCsXsBTdQNqLtuw9n60zb6dAUK0hLET-ek0sphnh9fCf-iRQjdwRoDpueuvkBYnt_DzgcqwuTKKvYYml2aWHRigekyM30PXKu6kDR-zxV4aZ54SE5SFNFaiKjkzAKNXsXcxSrWIE78niQu2l_KJaz74_IbG4DurjD-I Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:03:17.632272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9cfcfe1ebb994061b6d203510fd7e65b", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c96336eb4bfd461e82e7761077a5b910 Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.634543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f5ce34a4-1425-461c-a3f2-9c33ee80711a'} Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:17.635818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.639173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.642129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Returning 404 to user: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:17.642129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4356974f-dfa9-4eff-a457-e02ce160f4fb tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 404 len: 111 microversion: 2.1 time: 0.055209 Sep 08 14:03:17.642129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 101/198] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:17 2022] DELETE /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:17.651082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.652348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] [instance: f5ce34a4-1425-461c-a3f2-9c33ee80711a] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.664588 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.665476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.666285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.667713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.669692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.669692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.679962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:17.700097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] HTTP exception thrown: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Request method failure captured: Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a HTTP/1.1 Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXOr62TiY9diCsXsBTdQNqLtuw9n60zb6dAUK0hLET-ek0sphnh9fCf-iRQjdwRoDpueuvkBYnt_DzgcqwuTKKvYYml2aWHRigekyM30PXKu6kDR-zxV4aZ54SE5SFNFaiKjkzAKNXsXcxSrWIE78niQu2l_KJaz74_IbG4DurjD-I Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:03:17.703695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9cfcfe1ebb994061b6d203510fd7e65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9cfcfe1ebb994061b6d203510fd7e65b", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 9cfcfe1ebb994061b6d203510fd7e65b Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418972471 Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c96336eb4bfd461e82e7761077a5b910 Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-DeleteServersTestJSON-1418972471-project Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.715606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f5ce34a4-1425-461c-a3f2-9c33ee80711a'} Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:17.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. Sep 08 14:03:17.719437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:03:17.722685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] Returning 404 to user: Instance f5ce34a4-1425-461c-a3f2-9c33ee80711a could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:17.722685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-92eab86a-4941-4cc6-9aa2-7d5ba6718501 tempest-DeleteServersTestJSON-1418972471 tempest-DeleteServersTestJSON-1418972471-project] 10.222.0.97 "GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a" status: 404 len: 111 microversion: 2.1 time: 0.060796 Sep 08 14:03:17.722685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 102/199] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/f5ce34a4-1425-461c-a3f2-9c33ee80711a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:17.843403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:17.851929 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-38f95c34-051e-4973-9f3e-bf680c2f0199 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.300120 Sep 08 14:03:17.852542 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 98/200] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:18.888584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.889400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.891807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=60 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:18.897460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.898188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.898635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.899370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.899835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.900333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.160287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:19.177675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9e095472-588c-48c6-bac1-63024978e2fc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.295182 Sep 08 14:03:19.181302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 103/201] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:20.224445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:20.225518 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:20.236019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.236790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.237518 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.238556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:20.239294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:20.239986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.898278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:20.914352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7450dd3e-64f9-4344-bcdb-7aeb232bcc76 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.695206 Sep 08 14:03:20.916004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 99/202] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:20 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:21.946938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:21.950114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:21.987337 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.995661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.998063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.004317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:22.013034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:22.013871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:22.247681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:22.256406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-14adfbe6-8665-454b-94ae-81c70080e5f1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.321450 Sep 08 14:03:22.257382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 104/203] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:23.281664 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:23.282690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:23.295152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.296268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.297321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.300300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:23.301562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:23.302560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:23.841263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:23.853113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-103072eb-5a96-4d07-b02b-514edbd7aa35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.576231 Sep 08 14:03:23.853992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 100/204] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:23 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:24.888573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:24.889522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:24.898577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.900240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.900616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:24.901820 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:24.903186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:24.903992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.179186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:25.194477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-15a78224-b0cd-4563-9da1-9ee6ffe1649a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.310480 Sep 08 14:03:25.195533 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 105/205] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:24 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:26.235367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:26.235367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:26.242463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.243260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.246349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.247598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:26.248431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:26.249183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.496621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.513811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-01c5ded0-91e2-403c-889f-ac3720f8211c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.285458 Sep 08 14:03:26.520322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 101/206] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:26 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:27.501771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1adeca04-51ee-417e-b082-b26199d93bb0 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Action: 'create', calling method: .version_select at 0x7f7f8b4ea040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-358568793", "metadata": {"Type": "work"}}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:27.561953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:27.563050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:27.589223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.590438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.591509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.592882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.595170 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.596423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.844059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:27.854350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e0a2c135-023f-4d03-a4ed-2cb8d810cd55 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.300297 Sep 08 14:03:27.864810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 102/207] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:27 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:28.546936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1adeca04-51ee-417e-b082-b26199d93bb0 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.386666 Sep 08 14:03:28.547785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 106/208] 10.222.0.97 () {60 vars in 1156 bytes} [Thu Sep 8 14:03:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1388 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 08 14:03:28.565629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-111cad7b-4725-45ee-b72d-1916edcbbac7 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b286820>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:28.677411 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-111cad7b-4725-45ee-b72d-1916edcbbac7 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 200 len: 352 microversion: 2.1 time: 0.119235 Sep 08 14:03:28.678562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 103/209] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:03:28 2022] GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:28.880539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:28.881163 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:28.888416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.889103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.889567 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.890287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.890746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.891180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.060777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:29.073262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3e6af04b-6ccd-4c24-a7eb-ca1e419aa365 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.196829 Sep 08 14:03:29.074507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 107/210] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:28 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:29.694121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e97ac37c-ec76-4ab7-8852-b52b5226a25c tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b153160>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.762298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e97ac37c-ec76-4ab7-8852-b52b5226a25c tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 200 len: 353 microversion: 2.1 time: 0.072265 Sep 08 14:03:29.762887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 104/211] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:03:29 2022] GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:29.783349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-00d04edc-52cd-4581-9024-5860f78c6077 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b4ea040>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.861425 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-00d04edc-52cd-4581-9024-5860f78c6077 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 200 len: 353 microversion: 2.1 time: 0.081894 Sep 08 14:03:29.862907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 108/212] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:03:29 2022] GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:29.894215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-338d4586-4905-4b79-aba3-75619819189b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b2444c0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:30.098648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:30.099436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:30.109330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.109828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.110489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.111464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:30.112417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:30.113165 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:30.296110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-338d4586-4905-4b79-aba3-75619819189b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 202 len: 0 microversion: 2.1 time: 0.414588 Sep 08 14:03:30.296994 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 105/213] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:03:29 2022] DELETE /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:30.309551 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3a1f3770-d916-4f65-9b6f-4ea39831edb2 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b244700>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:30.346368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:30.373331 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-eb912b0d-d96d-4ca0-90c3-934d1e29a363 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.279428 Sep 08 14:03:30.373917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 109/214] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:30 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:30.409408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3a1f3770-d916-4f65-9b6f-4ea39831edb2 tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 200 len: 352 microversion: 2.1 time: 0.105854 Sep 08 14:03:30.418343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 106/215] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:03:30 2022] GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:31.420325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:31.422086 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:31.444756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ca2dade3-4fef-4c8b-a0e8-4d6f18c84f4b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Calling method '.version_select at 0x7f7f8b286a60>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:31.473555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.473555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.473555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.475041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:31.477411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:31.478523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:31.647977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-ca2dade3-4fef-4c8b-a0e8-4d6f18c84f4b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] HTTP exception thrown: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ca2dade3-4fef-4c8b-a0e8-4d6f18c84f4b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Request method failure captured: Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a HTTP/1.1 Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfYvaj1hY_fWSsXx3jSoQ39udhh1r6f_rkMZu4-cOMKYfEJbmoUz4sckwy1i2XRlt7ATMxMJC479dD8rkBjmIVwkCTjJ9y6yuEdBA3uOf3vTucppcOWSk_Bf5ZyuCTzAFiEHAmktO1It_nEJMvGCBdfZoyBc5Vj3_AE-6BTXyncCxwk Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: a9b5454a27cf4ddebff494a48d20586c Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesGetTestJSON-973756256 Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:03:31.654957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a9b5454a27cf4ddebff494a48d20586c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a9b5454a27cf4ddebff494a48d20586c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a9b5454a27cf4ddebff494a48d20586c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a9b5454a27cf4ddebff494a48d20586c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesGetTestJSON-973756256 Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: a9b5454a27cf4ddebff494a48d20586c Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesGetTestJSON-973756256 Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesGetTestJSON-973756256-project Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 093622ce75c74f5388e03101ffe99998 Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesGetTestJSON-973756256-project Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '3741008f-b934-4757-866a-1d6d9a43029a'} Sep 08 14:03:31.656124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. (HTTP 404) (Request-ID: req-0e2eccc6-cd1e-4a5e-b716-13d6078e0a1a) Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:31.656896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:03:31.657914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:03:31.658997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ca2dade3-4fef-4c8b-a0e8-4d6f18c84f4b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] Returning 404 to user: Volume 3741008f-b934-4757-866a-1d6d9a43029a could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ca2dade3-4fef-4c8b-a0e8-4d6f18c84f4b tempest-VolumesGetTestJSON-973756256 tempest-VolumesGetTestJSON-973756256-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a" status: 404 len: 109 microversion: 2.1 time: 0.217240 Sep 08 14:03:31.660009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 107/216] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:03:31 2022] GET /compute/v2.1/os-volumes/3741008f-b934-4757-866a-1d6d9a43029a => generated 109 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:31.728131 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:31.738833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-98a61672-d4c1-433f-aa14-0011a0034d8d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.327033 Sep 08 14:03:31.740624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 110/217] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:31 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:32.775862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:32.776612 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:32.788327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.788327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.788327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.789026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:32.789651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:32.790180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:32.991013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:33.000726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0b2c5d21-7931-4df9-9333-293c2d2f1288 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.234051 Sep 08 14:03:33.001368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 108/218] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:32 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:34.030443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:34.031595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:34.042691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:34.044047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:34.044870 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:34.046164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:34.047263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:34.048041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:34.273367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:34.288728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5e09e4e9-aced-4bbe-8e77-b33d134a0d35 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.266913 Sep 08 14:03:34.290534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 111/219] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:34 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:35.318939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:35.319917 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:35.331565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.332409 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.333146 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.334291 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:35.335331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:35.343842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:35.600873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:35.610746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6a46bbfb-e51a-454a-a236-9f35a2761302 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.298451 Sep 08 14:03:35.611579 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 109/220] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:35 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:36.637128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:36.637958 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:36.648634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.649142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.649584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.650541 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:36.651275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:36.652084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:36.843392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:36.852721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0c30e3e8-fbf5-4d4d-afdc-935a1750829c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.220990 Sep 08 14:03:36.853666 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 112/221] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:36 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:37.891085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:37.891706 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:37.898794 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.899293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.899731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:37.900813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:37.901456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:37.902930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:38.112436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:38.121063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1f0232cc-3f9e-4785-a7e2-347ed2eb38bf tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.233651 Sep 08 14:03:38.122187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 110/222] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:37 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:39.148480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:39.149771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:39.157809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.162610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.162610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:39.162610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:39.162610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:39.163076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:39.337699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:39.372974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2117c20c-a3cf-4d83-81bc-1223bda3a2be tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.230002 Sep 08 14:03:39.375382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 113/223] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:39 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:40.435540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:40.436719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:40.463532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:40.468868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:40.469323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:40.470357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:40.471031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:40.471684 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:40.697685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:40.714960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5cf111fa-2a0f-4c15-b184-8a7f3eb8d1dc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.300210 Sep 08 14:03:40.716344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 111/224] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:40 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:41.753659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:41.754447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:41.761095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.762260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.762721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.763435 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.763907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.764371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.989832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.007274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1f6a9333-55a0-439b-ac2a-deaa4d8c602c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.257430 Sep 08 14:03:42.007919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 114/225] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:41 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:43.048021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:43.049416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:43.057245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.058243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.058782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.059564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.060035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.060526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.380637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:43.400567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bc88e978-77f7-41b0-8e79-4f0a0fe3f9c2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.357043 Sep 08 14:03:43.417674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 112/226] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:43 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:44.443932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.445253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.458091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.458979 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.460122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.461709 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.462637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.463721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.926800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:44.936916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6610c0d5-ff5b-45e1-a7a7-89cdb37d8322 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.501067 Sep 08 14:03:44.938726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 115/227] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:44 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:45.913801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.913801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:45.921905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=28 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:45.924005 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.924637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.925272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.926105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:45.926651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:45.927754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.966968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a54352ee-30d7-4359-8107-0a5528742431 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/ips" status: 200 len: 147 microversion: 2.1 time: 0.058856 Sep 08 14:03:45.978179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 113/228] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/ips => generated 147 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:45.984495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:45.985457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:46.013388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.019209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.025106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.026589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.027644 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.028662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.406710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.415912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d84c17bf-21e8-4e10-aef6-fa1b3f78f7e2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.441216 Sep 08 14:03:46.417221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 116/229] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:45 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:47.460135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.461208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.470618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.471349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.471890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.472812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.473370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.474000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.784007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.786663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=78 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:47.794082 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9d593863-f74f-4dc7-afb1-1f0a76fe09b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.338522 Sep 08 14:03:47.794963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 114/230] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:48.819683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:48.820532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:48.829312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.830347 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.830793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:48.831596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:48.832104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:48.832734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.020441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:49.022772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=77 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:49.029925 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fcf6fef5-1760-4024-8e69-9ba50dc64759 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1522 microversion: 2.1 time: 0.214635 Sep 08 14:03:49.030616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 117/231] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:48 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:50.054845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:50.056113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.071311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.072027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.075099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.077052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.077774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.078373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.533142 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.542449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2fd1f9cc-8763-4830-8392-087a66fe957d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1502 microversion: 2.1 time: 0.491730 Sep 08 14:03:50.543586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 115/232] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:50 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1502 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:50.569270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:50.570501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.579132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=26 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:50.585698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.586467 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.589920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.590917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.593252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.593773 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.832937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.843482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-14d13659-4a30-4be9-b856-47ff45efba2c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1515 microversion: 2.1 time: 0.278612 Sep 08 14:03:50.844075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 118/233] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:50 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:53.015424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f361d291-0abc-45e8-a3f2-1589787700b3"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:53.018903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.028173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.029015 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.029846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.031207 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.031898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.032563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.586140 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:53.592324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:53.621025 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.623487 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.624037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.625230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:53.625816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:53.626747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.671681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'flavor' on Instance uuid 9ef13e6e-be3d-4cf5-977c-08a0521e5190 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:54.088452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7a961f1f-1aeb-4dde-9e42-04469eae13e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/action" status: 200 len: 32 microversion: 2.1 time: 0.506581 Sep 08 14:03:54.090061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 119/234] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:03:53 2022] POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/action => generated 32 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:03:54.108670 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.114993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.174161 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.175990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.184298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.184298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.184298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.184298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.510837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6322dbab-d4fe-4fe9-9968-be70dcd556da tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.501934 Sep 08 14:03:54.512489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 116/235] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:03:53 2022] POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments => generated 194 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:54.889706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.901342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-41d12ad3-5377-4837-baeb-5f0e12c80e43 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.796267 Sep 08 14:03:54.902046 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 120/236] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:54 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:55.940355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:55.941331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:55.960799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.965102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.966142 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.966954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.969038 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.969420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.247918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:56.275837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-200b3fee-68d3-4f84-8bbb-daa701bf0a4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.341887 Sep 08 14:03:56.300424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 117/237] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:55 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:57.332664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.333498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.344918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.345776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.346812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.348241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.349186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.349949 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.531065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.532256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.547720 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.548408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.549793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.551297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.553511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.553963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.620361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-34a12879-41fe-4d48-b76d-7abc902dde67 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/ips" status: 200 len: 149 microversion: 2.1 time: 0.095220 Sep 08 14:03:57.622348 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 118/238] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:57.839050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.848465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d317e95d-4fc9-406c-b9d2-3c5be8f91872 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.524712 Sep 08 14:03:57.870083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 121/239] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:58.877931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:58.878572 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:58.889451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.889963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.890418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:58.893098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:58.893639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:58.894089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.506182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.517949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-834b3746-47eb-44b8-8fe0-a24c8359f84a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.644315 Sep 08 14:03:59.519601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 119/240] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:58 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:00.546983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.549212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.568543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.594942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.596964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.601346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.602538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.604458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.943460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.954141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2e4c6b38-bc55-4c86-b8f8-31a82dd242bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.412609 Sep 08 14:04:00.956085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 122/241] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:01.517797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:01.521149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:01.551390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:01.551985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:01.552469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:01.553210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:01.553681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:01.554187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.007896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:02.020459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:02.035296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.047103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.047778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.048606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.048949 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.049387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.420734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:02.468295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aa1fc286-0fd3-4be0-83fc-5f77b9547c3c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.464328 Sep 08 14:04:02.471218 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 123/242] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:02 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:03.043254 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-984223a1-bfb2-4b05-af39-bd72c67dabec tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.532088 Sep 08 14:04:03.044801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 120/243] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:04:01 2022] POST /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments => generated 194 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:03.496783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:03.497441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:03.513488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.514351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.514918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.516595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:03.518214 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:03.520021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:03.839417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:03.869096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-751cacbe-c6f7-49f1-bcbf-fbcb14468c20 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.377462 Sep 08 14:04:03.872927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 124/244] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:03 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:04.908903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:04.911590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:04.924102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.925294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.926387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:04.928391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:04.928391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:04.929226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:05.268815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:05.278559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-44cf7691-ce20-40b6-98dc-584c53ca4db0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.381722 Sep 08 14:04:05.283818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 121/245] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:04 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:06.307063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:06.307946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:06.352931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.352931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.352931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:06.352931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:06.353520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:06.353520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:07.160358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:07.200684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3bd102a4-ff92-4a75-a857-6a6af477e3e1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.897456 Sep 08 14:04:07.206146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 125/246] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:06 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:08.244226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:08.248841 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:08.254045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.254965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.255650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.258843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:08.260032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:08.260741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:08.657804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:08.669477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b8497154-658f-44bb-951f-0556b20b3bff tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.431646 Sep 08 14:04:08.670718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 122/247] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:08 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:09.698056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:09.700405 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:09.719599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.734468 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.735219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:09.739106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:09.739783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:09.740550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:10.090591 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:10.100614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-62d2c2f6-0694-4f40-95c3-9a5ac8fe14c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.406381 Sep 08 14:04:10.101564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 126/248] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:09 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:11.134508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:11.139765 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:11.169456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.183216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.183216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.183216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.184762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.185651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:11.442832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:11.456238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9e708344-ca4a-40d1-a911-47a8194a28a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.334158 Sep 08 14:04:11.457506 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 123/249] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:11 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:11.962599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:11.969555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:11.970392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:11.971015 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.053765 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Going to try to stop instance {{(pid=128400) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 14:04:12.354636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-79ed7bf6-1200-43f6-b2ce-9e3f17808ec6 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action" status: 202 len: 0 microversion: 2.1 time: 0.394248 Sep 08 14:04:12.365926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 127/250] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:11 2022] POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:12.369345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:12.370136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:12.381908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.389030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.389779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.390850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.391482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.392206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.489163 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:12.490324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:12.554277 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.555270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.562771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.568993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:12.570349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:12.575352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:12.887548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:12.918979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-14f49f94-2bf1-456e-8c0c-17d816cf30cb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.551646 Sep 08 14:04:12.921733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 124/251] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:12 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:13.315668 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:13.331244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-012a7f9c-de81-401a-b78b-2e904aa9549d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.848709 Sep 08 14:04:13.332336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 128/252] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:12 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:13.947016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:13.947590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:13.955754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.956364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.956863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:13.957704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:13.958350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:13.958904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.102214 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:14.110723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-97b82da9-03c7-4835-9ac9-73993de8cf95 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.167757 Sep 08 14:04:14.111297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 125/253] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:13 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:14.379430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:14.380034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:14.391908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.392457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.392889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:14.393815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:14.394437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:14.400942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.040411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.040961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-14015423-b8ea-40f8-b684-42f8995e64ab tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.665429 Sep 08 14:04:15.042090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 129/254] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:14 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:15.137959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:15.138755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:15.147991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.160822 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.163194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.170596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.171659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.175728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.754333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.765409 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-06e26f4b-5f47-4760-9eef-580cf58a4f9b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.633754 Sep 08 14:04:15.766017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 126/255] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:15 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:16.067268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:16.075635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:16.087768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.088718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.091684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.092783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.093418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.098446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.765178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:16.777173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6c022693-6000-4a44-9fa7-9b1b06ba0e26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.713936 Sep 08 14:04:16.779835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 130/256] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:16 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:16.797982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:16.800066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:16.809475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.810428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.811198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:16.812096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:16.812837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:16.813578 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.630095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:17.654733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-73a062bf-6a8a-4bf4-80fe-b354ae7867ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.861038 Sep 08 14:04:17.668057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 127/257] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:16 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:17.806031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:17.806659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:17.829540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.836839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.836839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.836839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.837552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.837552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.176754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:18.531559 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:18.542584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-85fd4b36-3d8a-4623-9391-4986305ee862 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.740370 Sep 08 14:04:18.561191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 131/258] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:17 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:18.684645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:18.686738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:18.692481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=30 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:18.721977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.726685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.727533 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:18.729054 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:18.735172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:18.739027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.466654 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:19.477702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-674f1258-c4fb-4eff-a568-0af6f22d0731 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.799547 Sep 08 14:04:19.485302 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 128/259] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:18 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:19.568373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.569028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.580883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.584352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.585193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.586125 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.592441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.595700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.029420 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.036761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ea24da2e-8aea-4178-87b6-98d63d8e435b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.472277 Sep 08 14:04:20.050054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 132/260] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:20.504785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:20.506182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:20.520902 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.523591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.524487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.526614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.529315 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.530151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.544415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:20.610343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-31f0c71d-9979-4a64-87e8-e3b187c032fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: .version_select at 0x7f7f8b1610d0>, body: {"keypair": {"name": "tempest-keypair-278214401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDR/3eo0p7x3TXkaLV+GFOhF74elKekvKaspmSAM7bzgomw1PH2NE7qvUc3HZBbsq1wk+L2hO9BVJXnLkIWiS1Jv3hZ4zbWhHjGeagDIUlBgBWXv8cxB5xkrIgLsl1GvEA=="}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:20.642141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-31f0c71d-9979-4a64-87e8-e3b187c032fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:20.647167 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-31f0c71d-9979-4a64-87e8-e3b187c032fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:20.821657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-31f0c71d-9979-4a64-87e8-e3b187c032fc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215332 Sep 08 14:04:20.830532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 133/261] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:21.067195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:21.067924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:21.084635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.085204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.085652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.086455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:21.086923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:21.087351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:21.369500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.379732 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fa65751e-30e8-4df2-a94c-4a70394c9bed tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.880907 Sep 08 14:04:21.385179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 129/262] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:20 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:21.770079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:21.790910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3203e71e-887f-4111-b823-d17f1035d1d4 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.730100 Sep 08 14:04:21.805433 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 134/263] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:21 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:22.414452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:22.415642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:22.443053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.447175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.447904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.448763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.452645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.453439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.821508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:22.822368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:22.843040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.845639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.854562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.857321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:22.863806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:22.864611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:22.960806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:22.979329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2f3517d2-d133-460e-8d44-8b5484edeeab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.571610 Sep 08 14:04:22.997057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 130/264] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:22 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:23.761257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:23.779592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-020c3711-d6a1-4d95-941c-056d7f72dea0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.963797 Sep 08 14:04:23.780782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 135/265] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:22 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:24.008112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.008112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.013799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.019127 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.020391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.020621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.021007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.024221 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.602613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:24.615203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f79fd24e-c832-444f-9be7-a23b57da4bfb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.610709 Sep 08 14:04:24.616104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 131/266] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:24.805781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:24.806395 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:24.818650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:24.827940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.828557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.835481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:24.840357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:24.840969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:24.841429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.367937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:25.386800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a76a0ffd-7a10-4f9f-8393-5dd635011965 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1501 microversion: 2.1 time: 0.584932 Sep 08 14:04:25.389228 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 136/267] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:24 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1501 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:25.407975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-430e8d3c-cd80-4c5d-bbb5-627ea4cc6317 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Action: 'create', calling method: .version_select at 0x7f7f8b2e1dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-125580282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIGuXGieQp0tac/EgAsV0z8OGnpzEYdPEXtmKPWmX7EFHQbx2bxJpvF+hRKT8bmITgRl5jQ6DLbw0Kx3ejynfvY4T4TvaTDPxsogvanD5xIlTDxn9C7aXcThJfmnMkKJA=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:25.416962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4a4e30c-a892-4cc6-a39b-215ed3b00627"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:25.435204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.443417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.444447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.445945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.446831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-430e8d3c-cd80-4c5d-bbb5-627ea4cc6317 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Getting quotas for project fe528c21e8c94eb6af8d5f86757328b8. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:25.447779 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.448725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.449883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.486010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-430e8d3c-cd80-4c5d-bbb5-627ea4cc6317 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Getting quotas for user 1729bb4d783f425085185c344dfe2ab8 and project fe528c21e8c94eb6af8d5f86757328b8. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:25.500048 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] HTTP exception thrown: Cannot 'attach_volume' instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 while it is in vm_state rescued Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Request method failure captured: Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/os-volume_attachments HTTP/1.1 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 74 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXJoEaOlgKFoM9AgkAccLUDTEkz4oDr1gObZObhuPiKiHOchyMYcqKSMKpHM9_zgjn_Jj3-GkQBVSojGJ-gFroxtE7UIMPFlpPZUU_SI68BZdDBeOXqWbTY99O2UNQ0LcJld5Uc9nNvmTZ-7Mb-OjIy3Vyh4H82EUyDKmRtVNSHdiU Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:04:25.512976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_44e7a5fc099c4041aa1a3109962b5dc3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: a30b0734975d4e5a848be44aa7860807 Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {"volumeAttachment": {"volumeId": "a4a4e30c-a892-4cc6-a39b-215ed3b00627"}} Sep 08 14:04:25.518248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Cannot 'attach_volume' instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 while it is in vm_state rescued Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'server_id': '9ef13e6e-be3d-4cf5-977c-08a0521e5190', 'body': {'volumeAttachment': {'volumeId': 'a4a4e30c-a892-4cc6-a39b-215ed3b00627'}}} Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:04:25.519005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 while it is in vm_state rescued Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:04:25.520655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 while it is in vm_state rescued Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Returning 409 to user: Cannot 'attach_volume' instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 while it is in vm_state rescued {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-03f1fb58-6318-44e7-9c0c-6c378c6435eb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.103818 Sep 08 14:04:25.521738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 137/268] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:04:25 2022] POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:04:25.530754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:25.531301 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.569556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.570070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.570513 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.571246 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.571712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.572162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.702810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-430e8d3c-cd80-4c5d-bbb5-627ea4cc6317 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.695818 Sep 08 14:04:25.713722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 132/269] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:25.719299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.720074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:25.757547 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.763427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.763934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.764757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:25.765240 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:25.765735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:25.960282 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-680bfef1-26b3-4066-a1de-52ec1d423094 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/action" status: 202 len: 0 microversion: 2.1 time: 0.441607 Sep 08 14:04:25.964034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 138/270] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:25 2022] POST /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:25.974502 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:25.980712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:26.007101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:26.008961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:26.009446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:26.010229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:26.010742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:26.021668 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:26.290982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:26.302042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3502b6dd-5d87-4e05-8acc-a658d33dbdb5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.587313 Sep 08 14:04:26.302628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 133/271] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:26.410317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:26.431998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-13d25dae-5e33-4257-9c7f-3417dd8e42d5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1509 microversion: 2.1 time: 0.466281 Sep 08 14:04:26.432770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 139/272] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:25 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1509 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:27.203613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-be52f06a-38e9-421a-ae97-c69186e44d96 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'create', calling method: .version_select at 0x7f7f8b2e1040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-277873648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxOZjAF/ZAB1b2LI+fAH3Nbf+IQVmVgeZt7MV9mmyb+gtIjIrWTyTX1+ai8gK43f8LazGoTvybKUDGASzd+UCzuck/R/oPidZg7PgnfR338ahpv2SuGVkS0r74EAqlIoQ=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:27.233070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-be52f06a-38e9-421a-ae97-c69186e44d96 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Getting quotas for project 9aa00aef04784c1ea61221c69e872045. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:27.239855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-be52f06a-38e9-421a-ae97-c69186e44d96 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Getting quotas for user 775ee674f5084d01b48d7b3ef20c7864 and project 9aa00aef04784c1ea61221c69e872045. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:27.333996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:27.334764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:27.344657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.345928 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.346539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.347345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.348001 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.348604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.380634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-be52f06a-38e9-421a-ae97-c69186e44d96 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.182855 Sep 08 14:04:27.381258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 134/273] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:27.457367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:27.458044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:27.465446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.465962 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.471256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.475641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:27.476688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:27.480812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:27.900656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:27.908818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:27.910833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-29b8803d-3a0d-4549-8438-15a4174fb788 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.587350 Sep 08 14:04:27.911418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 140/274] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:27 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:27.924350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c263074b-4862-4e1f-9b84-76807f4ed952 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1509 microversion: 2.1 time: 0.471399 Sep 08 14:04:27.925634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 135/275] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:27 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:27.931661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-314209212", "imageRef": "7a6c9964-3116-4855-9169-7892c2e945a5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-277873648", "networks": [{"uuid": "4f73a88b-2c7b-493b-a879-7031ba9e9abb"}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:28.030483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] validate_networks() for [('4f73a88b-2c7b-493b-a879-7031ba9e9abb', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:28.413689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-397431041", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ef396a-7d6a-46fb-a5b2-7b67636f85e3"}], "security_groups": [{"name": "tempest-securitygroup--574688189"}], "key_name": "tempest-keypair-278214401", "user_data": "}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:28.870356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] validate_networks() for [('21ef396a-7d6a-46fb-a5b2-7b67636f85e3', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:29.486298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:29.487529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:29.488407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:29.489100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:29.490093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:29.539280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.540238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.541140 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.544286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.545068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.545684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.574254 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Getting quotas for project 9aa00aef04784c1ea61221c69e872045. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:29.585000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Getting quotas for user 775ee674f5084d01b48d7b3ef20c7864 and project 9aa00aef04784c1ea61221c69e872045. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:29.621661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:29.622350 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a6c9964-3116-4855-9169-7892c2e945a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:29.773625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aeaed2c0-f823-4cba-b071-64cd1da66558 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.860055 Sep 08 14:04:29.778048 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 141/276] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:04:29.794056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:29.797549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:29.810758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.811690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.812383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:29.813307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:29.825908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:29.825908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.059278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:30.062296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:30.063127 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:30.069019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:30.069019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:30.116738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.123021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.124942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.125402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.129494 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e37d2a13-8c50-45cf-9dfc-1418be68e451 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.346510 Sep 08 14:04:30.131809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.132634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.133237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.138408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 142/277] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:29 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:30.144419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:30.159037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:30.176245 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.178697 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.179389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.184505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:30.185646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:30.186297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:30.192469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:30.209288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:30.247162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:30.264416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:30.406319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.431741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-951046bc-31bf-44d5-a862-30f523ae4d7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1515 microversion: 2.1 time: 0.292102 Sep 08 14:04:30.435886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 143/278] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:30 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:30.448359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-611b9ff7-52fb-4aaa-abc7-08df4f9109bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:30.450908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-611b9ff7-52fb-4aaa-abc7-08df4f9109bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:30.571869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a4a8169e-a470-44ee-a566-9b4646073563 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.162776 Sep 08 14:04:30.576093 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 136/279] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:04:30.619173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-30fe0c50-7737-4928-a108-86b1fa78ca91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:30.623530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-30fe0c50-7737-4928-a108-86b1fa78ca91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:30.736912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-611b9ff7-52fb-4aaa-abc7-08df4f9109bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.760606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-611b9ff7-52fb-4aaa-abc7-08df4f9109bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1257 microversion: 2.1 time: 0.323329 Sep 08 14:04:30.764621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 144/280] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:30 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1257 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:30.898379 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-30fe0c50-7737-4928-a108-86b1fa78ca91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:30.928070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-30fe0c50-7737-4928-a108-86b1fa78ca91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1240 microversion: 2.1 time: 0.339477 Sep 08 14:04:30.930768 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 137/281] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:30 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1240 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:31.157814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.158475 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.170030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.170539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.170982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.193486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.193992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.194447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.532172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:31.549999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9fbdbe8f-b2c9-44a7-8c3b-f631fc488280 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.396774 Sep 08 14:04:31.552948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 145/282] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:31.793332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.794820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.803599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.804327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.804975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.807018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:31.807437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:31.808091 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:31.931517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:31.983636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d3620087-1507-4865-b006-06ac50a695bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:31.983636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d3620087-1507-4865-b006-06ac50a695bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:31.984487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b1a4afc3-aa66-45f4-8207-b60592882fe7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1261 microversion: 2.1 time: 0.193681 Sep 08 14:04:31.984981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 138/283] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:32.163685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d3620087-1507-4865-b006-06ac50a695bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:32.171810 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d3620087-1507-4865-b006-06ac50a695bf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1240 microversion: 2.1 time: 0.206033 Sep 08 14:04:32.173465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 146/284] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:31 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1240 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:32.596110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:32.599452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:32.685049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:32.695804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:32.695804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:32.695804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:32.695804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:32.696398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.011312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:33.012557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:33.030503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:33.031316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:33.034330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.035219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:33.035974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:33.038891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.146886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:33.178268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1151f610-f662-47c1-a096-0229cc6a91c4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.589837 Sep 08 14:04:33.194467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 139/285] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:32 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:33.223042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:33.224271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:33.231626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:33.232109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:33.232646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.233374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:33.234039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:33.234643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:33.419486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:33.479521 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f44225c3-04b3-4f51-8c99-e471e5e4386f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1253 microversion: 2.1 time: 0.473261 Sep 08 14:04:33.485080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 147/286] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:33 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1253 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:33.561056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:33.570792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-22f74e5f-64da-4865-bdeb-e0fe2df0bb00 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: .version_select at 0x7f7f8b16b8b0>, body: {"keypair": {"name": "tempest-keypair-2141537914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoOSiJZtG6ZoPCYC0nuOCWFy9LZ4wlL8sLTRHV+O5GnX7nY0uz8eziLGqVu/lraHEYrXVi9Oz8M5fP3zSJVtVaJpTAz6WRdGm9pD1hRU58HdOSzqBG2R+/XEre4+oC6eg=="}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:33.575589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6f984786-1e15-4ce4-a0f4-470d2e16e435 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1244 microversion: 2.1 time: 0.371616 Sep 08 14:04:33.580323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 140/287] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:33 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1244 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:33.627316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-22f74e5f-64da-4865-bdeb-e0fe2df0bb00 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:33.648715 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-22f74e5f-64da-4865-bdeb-e0fe2df0bb00 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for user a30b0734975d4e5a848be44aa7860807 and project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:33.874153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-22f74e5f-64da-4865-bdeb-e0fe2df0bb00 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310513 Sep 08 14:04:33.880582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 148/288] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:34.238733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:34.239989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.267314 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.267848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.271214 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.272298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.272948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.273645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.526775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:34.528088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.547704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.548255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.549112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.549889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.550433 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.550872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.727255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:34.748552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b3f88f0d-2f97-4282-b658-5d7ea5d009d4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1309 microversion: 2.1 time: 0.225728 Sep 08 14:04:34.749459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 149/289] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:34 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:34.756789 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:34.757708 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.765172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.765996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.766705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.772913 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.774307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.774952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.789099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:34.804667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f5a7c8fe-636b-4125-b533-29809dcde94a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.568489 Sep 08 14:04:34.805745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 141/290] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:34 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:35.024222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:35.049074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ac892b30-537d-48a9-b34a-731cf8bfc527 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1236 microversion: 2.1 time: 0.297636 Sep 08 14:04:35.050152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 150/291] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:34 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1236 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:35.780711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:35.782590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:35.792061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.793955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.799659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.799659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.799659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.799659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.842089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:35.843451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:35.883744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:35.887123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.904412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-282f2213-c393-4ff2-8d1c-70870b3a0013 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1317 microversion: 2.1 time: 0.124280 Sep 08 14:04:35.904632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.904632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.904632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:35.910432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:35.911287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:35.911457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 142/292] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:35 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:36.074049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:36.074711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:36.082913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.083960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.084681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.086145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.086891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.087568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.423525 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:36.447024 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e5a64fa8-9588-4e70-ab4b-f1cf39f29f46 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1292 microversion: 2.1 time: 0.376595 Sep 08 14:04:36.457848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 143/293] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:36 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1292 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:36.691562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:36.702778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-125729e0-5bc7-4924-b859-270f7473d885 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.874543 Sep 08 14:04:36.713525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 151/294] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:35 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:36.943856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:36.944528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:36.954735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.955653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.957778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.958852 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.959741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.960938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.492035 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:37.492909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:37.506718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.510410 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.511090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.514481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.519307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.521858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.542361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:37.630912 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:37.682407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0f29a852-b947-474a-a9f2-ddb9b8197ab4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.751189 Sep 08 14:04:37.696018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 144/295] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:36 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:37.767051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:37.771785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:37.802173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.802873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.803435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.804459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.818062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.818811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.426222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:38.451317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6127a7d2-605d-46a6-90e8-8c6f033ac68b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1310 microversion: 2.1 time: 0.964000 Sep 08 14:04:38.451944 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 152/296] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:37 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1310 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:38.735970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:38.737974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:38.748726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.750040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.750751 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.752689 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.753449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.754128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.775409 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:38.787767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-49716653-f32b-468c-ae3d-c814d52b6ec3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 1.028584 Sep 08 14:04:38.804531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 145/297] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:37 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:39.231635 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:39.243924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-00e5d0da-786a-474e-97d2-98c7ca1c4e87 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.515978 Sep 08 14:04:39.262049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 153/298] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:38 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:39.501643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:39.503614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:39.518762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.518762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.518762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:39.531490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.531998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.535260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:39.780860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:39.805557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a4fe7953-7bf6-4cec-8ec2-59eba8053e12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1298 microversion: 2.1 time: 0.300677 Sep 08 14:04:39.810589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 146/299] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:39 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1298 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:39.826775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:39.828270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:39.845297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:39.853112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.853617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.854066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:39.854859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.869079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.869079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:40.274918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:40.275944 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:40.286323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:40.287963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:40.288517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:40.288964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:40.306740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:40.307313 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:40.307779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:40.909383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=16 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:42.079966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:42.099588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:42.104329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-abdfaa22-9670-4dd6-914b-4d591635e662 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 2.274455 Sep 08 14:04:42.117667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 154/300] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:39 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:42.124130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-34e5e8ef-7214-46d0-9840-b660b50cb714 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 1.847986 Sep 08 14:04:42.125601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 147/301] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:40 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:42.141941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:42.142865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:42.145440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:42.174519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.175214 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.175818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.177441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.181627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.183921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.186920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.194675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.195820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.243192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] Creating event network-changed:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:04:42.265355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-dbd45dd0-65b6-44b8-97aa-263d252ebba3 req-0a2d9844-f00d-42ef-acc2-77f83ff4a18a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120148 Sep 08 14:04:42.266052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 148/302] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:42.626699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:42.644404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8790c7bc-6ac1-4d59-a1dd-199fc8ac75a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.522201 Sep 08 14:04:42.647681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 155/303] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:42 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:42.821842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1223007668", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "182a2fc0-a3a1-4a15-a5cd-df587300306f"}], "security_groups": [{"name": "tempest-securitygroup--721540304"}], "key_name": "tempest-keypair-2141537914", "user_data": "}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:43.142495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:43.143116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:43.179879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.184780 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.186879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.188811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.193250 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.193915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.577695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:43.608198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-71e92e16-7ab2-43c1-a15a-4586f6946587 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1724 microversion: 2.1 time: 0.469066 Sep 08 14:04:43.623527 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 156/304] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:43 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:43.637018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:43.638233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:43.646839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.647931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.648758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.649772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.650477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.651177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.677597 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=18 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:44.030449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:44.039970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c5b97c1d-c651-4ec2-b8a8-96af4b80add0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.415152 Sep 08 14:04:44.040790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 157/305] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:43 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:44.061938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:44.061938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:44.075653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.076166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.076624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:44.077345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.077819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.078239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:44.415613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:44.443334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-edaf1f34-e3b1-4e52-b912-3c816fa60280 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.400817 Sep 08 14:04:44.445342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 158/306] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:44 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:44.757082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c9281970-53db-4863-9262-0c39b4053946 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Action: 'create', calling method: .version_select at 0x7f7f8b16b430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-23972180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuyHK2TK2Hew2xiBxEGoKM0DldK7Xua4xC1MYjyERDJoQiuHX+8PWHrbbsJw4DtPNCOx5xJgVS3o3u3BOSgeQO5XK0gQasS0HAich1Howex20JFgt29viSGKXDu7zjsbw=="}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:44.785422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-c9281970-53db-4863-9262-0c39b4053946 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for project ae31829bffd7483fbab3dc87635aea58. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:44.793009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-c9281970-53db-4863-9262-0c39b4053946 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for user 26aa79753d6e4e49ad66cc32ba786fe8 and project ae31829bffd7483fbab3dc87635aea58. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:44.986854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c9281970-53db-4863-9262-0c39b4053946 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.539970 Sep 08 14:04:44.987459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 159/307] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:04:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:44.992230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:44.993058 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:45.014089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.014589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.015685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.018230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.019868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.020535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.247220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:45.262684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8ac44632-e7ba-418c-899f-d3a9502a77ab tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1701 microversion: 2.1 time: 0.273203 Sep 08 14:04:45.263612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 160/308] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:44 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1701 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:45.292586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57436947-9181-4656-8f1a-651b365e68bb", "tag": "03f5ab8d-d0a4-468c-b74c-c7f792d4bcea"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:45.306289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.307374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.309154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.334371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] Creating event network-changed:03f5ab8d-d0a4-468c-b74c-c7f792d4bcea for instance 57436947-9181-4656-8f1a-651b365e68bb on hv-cinder-85646 Sep 08 14:04:45.349460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-2a9a2167-b854-4be9-b6ac-579441f61aaa req-00b958d4-ea89-429b-94fb-1e55786aabcd service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062313 Sep 08 14:04:45.350644 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 161/309] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:45.358924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:45.360203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:45.387624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.392519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.393061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.394056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.394854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.395291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.623908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:45.644045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c6e6526f-f4b3-4819-bb0c-a497a3f32f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.291797 Sep 08 14:04:45.666345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 162/310] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:45 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:45.677351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:45.692846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:45.693698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:45.697230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:45.733952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Going to try to start instance {{(pid=128400) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 14:04:46.068632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-79c041d1-0055-4001-97b8-e0371c906600 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action" status: 202 len: 0 microversion: 2.1 time: 0.404922 Sep 08 14:04:46.073488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 163/311] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:45 2022] POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:46.079004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] validate_networks() for [('182a2fc0-a3a1-4a15-a5cd-df587300306f', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:46.079950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:46.080883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:46.090611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.091366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.092156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.093291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.094126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.094885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.452237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:46.457769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b9147b85-afa0-482b-854e-42b1c45e3016 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.382506 Sep 08 14:04:46.462283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 164/312] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:46 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:46.471220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:46.472591 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:46.507383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.508928 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.510316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.516752 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.517416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.517882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.851595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:46.860888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b5abc799-2e91-4f1d-afcf-d9e9dceb3cd2 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.395576 Sep 08 14:04:46.862023 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 165/313] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:46 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:46.879382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:46.887149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:46.890652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:46.908184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.908948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.909570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.910451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.920358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.920358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.694956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:47.706638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-72dbba57-d23e-400b-a92e-5c5f91a0f822 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.843465 Sep 08 14:04:47.715948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 166/314] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:46 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:47.723412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:47.728666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:47.728666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:47.728877 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:47.728961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:47.728961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:47.729134 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.748768 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.749297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.749919 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.750217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.750987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.751875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.752345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.752849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.753498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.754110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.754697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.755249 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.787292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:47.793295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Getting quotas for user a30b0734975d4e5a848be44aa7860807 and project 44e7a5fc099c4041aa1a3109962b5dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:47.810659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:47.816993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:48.029812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-67407ec4-cbe4-4a13-8ae2-9087743cf773 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.222480 Sep 08 14:04:48.031342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 149/315] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 5225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:04:48.065928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:48.067494 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:48.093025 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.093537 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.093970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.094685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.095142 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.095595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.114109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.129236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6d17dcc1-e065-4469-a04c-ed921b4cf6fd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.411615 Sep 08 14:04:48.132847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 167/316] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:47 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:48.142032 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d0942394-7d42-4f71-8fd8-c72a1a3ace51 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:48.142902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d0942394-7d42-4f71-8fd8-c72a1a3ace51 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:48.277271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d0942394-7d42-4f71-8fd8-c72a1a3ace51 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.286128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d0942394-7d42-4f71-8fd8-c72a1a3ace51 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1246 microversion: 2.1 time: 0.151397 Sep 08 14:04:48.289154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 168/317] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:48 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1246 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:48.514234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.516710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:48.524985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c0a7c5c3-bb88-418c-bbc1-ad73ba48ab6a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.488644 Sep 08 14:04:48.525921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 150/318] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:48 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:48.800766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:48.800766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:48.800766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.800766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.802084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.802084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.802084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.802084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.904680 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.915404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aa7fc2c9-b161-498e-89d7-0db417a463bc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.189581 Sep 08 14:04:48.915994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 169/319] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:48 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:49.162017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.162600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.164501 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:49.170532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.171098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.171543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.172470 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.172940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.173367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.309950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:49.315566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3a129255-5954-42a6-a62d-5b7ec6ff2ca9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.317292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3a129255-5954-42a6-a62d-5b7ec6ff2ca9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.318419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-66df07c9-c87e-4c6f-bb5b-7c84f57e926e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.160383 Sep 08 14:04:49.319180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 151/320] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:49.377659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3a129255-5954-42a6-a62d-5b7ec6ff2ca9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:49.384777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3a129255-5954-42a6-a62d-5b7ec6ff2ca9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1246 microversion: 2.1 time: 0.075936 Sep 08 14:04:49.385344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 170/321] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:49.554795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.555792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.565609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.566457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.568440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.569519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.581022 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.581577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.755499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:49.792976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fead8c48-7ccb-48af-bbe5-cd376b2ae059 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.242171 Sep 08 14:04:49.793787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 152/322] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:49.940629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.941257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.956204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.959860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.959860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.959860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.959860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.960272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.976858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:50.145981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:50.159544 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-af7aee96-5881-4752-9abc-f61376b53f0a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.223040 Sep 08 14:04:50.160644 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 171/323] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:50.342800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:50.343482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:50.349815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.350298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.350737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.351424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.351885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.352360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.412563 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3798cf4f-69bb-420f-ab73-41466dc37e4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:50.423200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3798cf4f-69bb-420f-ab73-41466dc37e4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:50.572292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3798cf4f-69bb-420f-ab73-41466dc37e4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:50.582607 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3798cf4f-69bb-420f-ab73-41466dc37e4a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1246 microversion: 2.1 time: 0.177829 Sep 08 14:04:50.596730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 172/324] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:50 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1246 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:50.637931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:50.646820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ef15a874-953e-456d-8a4a-a482bf7e45a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.308896 Sep 08 14:04:50.647413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 153/325] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:50 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:50.818061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:50.818809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:50.833884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.834384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.834864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.835774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.836298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.836729 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.072946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.085405 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-915c158a-e560-4584-b3ba-8690f083c6cd tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.269804 Sep 08 14:04:51.090443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 173/326] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:50 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:51.193644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:51.195078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:51.202759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.203529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.204301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.205423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.206046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.206631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.464318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.472491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b957bb7b-073c-4287-9a5e-c4bbba0806cd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.283350 Sep 08 14:04:51.484651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 154/327] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:51 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:51.608864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:51.608864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:51.616078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.616880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.617508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.618422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.618886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.619492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.676324 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:51.676973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:51.684444 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.685305 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.685814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.686570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:51.687075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:51.687447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.730526 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.740480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-87b3e80f-fe48-4c16-adb3-20912443f17f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1250 microversion: 2.1 time: 0.137367 Sep 08 14:04:51.741342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 174/328] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:51 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1250 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:51.850549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.860344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-579bc41b-971d-48d0-9b94-2c9b1936d365 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.188914 Sep 08 14:04:51.861424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 155/329] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:51 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:52.080959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1594096874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-125580282", "security_groups": [{"name": "tempest-secgroup-smoke-1503034696"}], "networks": [{"uuid": "9fafb4eb-dbc2-47ca-aa8d-d7af3c1b9193"}], "block_device_mapping_v2": [{"uuid": "d1400e84-4c33-48b7-a901-9ecf548b2412", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:52.107870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:52.109013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:52.120070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.120070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.120070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.120881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.121442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.121947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.311733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] validate_networks() for [('9fafb4eb-dbc2-47ca-aa8d-d7af3c1b9193', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:52.334408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:52.344294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-81f28779-7708-4457-99c3-28e171b0cdd9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.241385 Sep 08 14:04:52.344989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 156/330] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:52 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:52.350496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57436947-9181-4656-8f1a-651b365e68bb", "name": "network-vif-plugged", "status": "completed", "tag": "03f5ab8d-d0a4-468c-b74c-c7f792d4bcea"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:52.361721 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.362524 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.363166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.375936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] Creating event network-vif-plugged:03f5ab8d-d0a4-468c-b74c-c7f792d4bcea for instance 57436947-9181-4656-8f1a-651b365e68bb on hv-cinder-85646 Sep 08 14:04:52.381276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-1e59c718-bfc6-4992-933c-1ce1d88514f5 req-3ef2c01a-72fa-4223-b32b-b1dcc525e68d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Sep 08 14:04:52.382641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 157/331] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:52.498673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:52.499324 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:52.506346 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.506846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.507285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.508057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.508547 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.508985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.863017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:52.871406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c71c9914-e0e3-498d-a0c8-a242609d58ae tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.376875 Sep 08 14:04:52.872031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 158/332] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:52 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:52.876702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:52.886062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:52.886062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.886062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.886062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.886531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.886531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.887660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.970689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:52.979325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2534346c-465e-4296-a50c-36f3f3b18321 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1250 microversion: 2.1 time: 0.106228 Sep 08 14:04:52.979901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 159/333] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:52 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:52.992322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:52.992322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:52.992964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.992964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.993360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.994429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.995033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.995619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.137987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:53.138590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:53.138959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:53.139369 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:53.139791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:53.148929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.149418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.149864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.150606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.151200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.151620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.169038 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:53.178040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-985837b7-4250-49da-b8e9-c55f44e43de2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.196459 Sep 08 14:04:53.178876 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 160/334] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:52 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:53.192295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Getting quotas for project fe528c21e8c94eb6af8d5f86757328b8. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:53.192295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Getting quotas for user 1729bb4d783f425085185c344dfe2ab8 and project fe528c21e8c94eb6af8d5f86757328b8. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:53.249905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:53.252027 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1400e84-4c33-48b7-a901-9ecf548b2412',volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:53.368604 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.369316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.376517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.394500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.394500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.394500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.394500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.395370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.549391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:53.559836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9ebc5888-26c5-4ee7-aa3a-8031df3c9793 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1710 microversion: 2.1 time: 0.195748 Sep 08 14:04:53.560491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 161/335] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:53 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:53.881259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-133d921d-5bb5-47c3-909b-e90a63cf5503 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.804139 Sep 08 14:04:53.891457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 175/336] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:04:53.897524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2cb56249-e833-4592-abc8-c4509f984bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.898528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2cb56249-e833-4592-abc8-c4509f984bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.898725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:53.899616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:53.908593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.909788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.910871 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:53.911964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:53.913732 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:53.915990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.033506 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2cb56249-e833-4592-abc8-c4509f984bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:54.046803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2cb56249-e833-4592-abc8-c4509f984bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1088 microversion: 2.1 time: 0.153738 Sep 08 14:04:54.047404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 176/337] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:53 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1088 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:54.052664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:54.055792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:54.073807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.079259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.079259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.079259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.079259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.079703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.192509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:54.195905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:54.205607 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ac735ef1-2057-415b-8ae8-83ec4f8077a9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1242 microversion: 2.1 time: 0.155576 Sep 08 14:04:54.206381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 177/338] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:54 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:54.207662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d07b4595-38db-40b6-b7d5-a806c96d8b9e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.315051 Sep 08 14:04:54.209049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 162/339] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:53 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:54.228038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:54.232431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:54.240770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.241247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.242009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.242728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.243183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.243772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.415503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:54.423511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f0d516eb-a1c3-4b13-9a4b-fa1dd639d90b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.215662 Sep 08 14:04:54.424113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 178/340] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:54 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:54.590083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:54.590798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:54.597473 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.610567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.610567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.610567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:54.610567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:54.613455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:54.784838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:54.798407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8e6ba7b5-f756-4017-af47-17b33bc1f2f9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1714 microversion: 2.1 time: 0.212059 Sep 08 14:04:54.803487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 163/341] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:54 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1714 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:55.070866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8c4803a1-5c9e-48f9-9210-f96dcc628fbf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:55.071512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8c4803a1-5c9e-48f9-9210-f96dcc628fbf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:55.143661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8c4803a1-5c9e-48f9-9210-f96dcc628fbf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:55.153720 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8c4803a1-5c9e-48f9-9210-f96dcc628fbf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1088 microversion: 2.1 time: 0.087352 Sep 08 14:04:55.154582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 179/342] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:55 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:55.231983 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:55.232993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:55.233514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:55.234150 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:55.240529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.241142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.241427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.241588 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.241931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.242374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.242510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.242919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.243077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.243349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.243540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.243973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.343378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:55.351385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0938c549-81b7-44d5-8b39-7da4bc6f718d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1298 microversion: 2.1 time: 0.124917 Sep 08 14:04:55.352011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 164/343] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:55 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:55.417082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:55.426498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1ed72d0d-2980-4be1-9f63-872f9ff90ee4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.199319 Sep 08 14:04:55.427359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 180/344] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:55 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:55.447351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:55.447838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:55.454756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.455248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.455660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.456490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.456942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.457397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.521833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1905290907", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:55.576522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] validate_networks() for None {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:04:55.629285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:55.640012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-88ad5a7c-2b3c-49e0-9512-6c66579c5471 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1365 microversion: 2.1 time: 0.196797 Sep 08 14:04:55.642942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 165/345] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:55 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:55.913316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:04:55.913822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:04:55.914316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:04:55.914776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:04:55.915153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:04:55.925942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.926922 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.927362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.928109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:55.928591 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:55.929020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:55.950527 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Getting quotas for project 9a212684b7034dd2a02eff9cc2a3dbd8. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:04:55.954982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Getting quotas for user 187691a095d94a6591ff94eeef7c41c7 and project 9a212684b7034dd2a02eff9cc2a3dbd8. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:04:55.967399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:04:55.969747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:04:56.100498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-faeed22a-6a75-4a8a-ba22-ddc239925fe2 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582894 Sep 08 14:04:56.101151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 181/346] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:04:56.125827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d615e739-f833-4673-a4b9-4dacc63ae9a7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.127242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d615e739-f833-4673-a4b9-4dacc63ae9a7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.182411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.183094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.191507 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d615e739-f833-4673-a4b9-4dacc63ae9a7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.200062 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.201374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.203435 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.204318 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.205281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.207075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d615e739-f833-4673-a4b9-4dacc63ae9a7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1215 microversion: 2.1 time: 0.085905 Sep 08 14:04:56.207592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.209534 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 166/347] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:56.324654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.331955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "name": "network-vif-plugged", "status": "completed", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:56.334123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-545946e2-d657-4adb-9985-2404300503e0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1138 microversion: 2.1 time: 0.156546 Sep 08 14:04:56.336190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 182/348] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1138 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:56.343079 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.344129 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.344595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.359713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] Creating event network-vif-plugged:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:04:56.365275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-c59fa625-d152-4963-be4e-fd6c88db4efb req-97f296a0-58ac-44fe-93ad-fbd274219f60 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037093 Sep 08 14:04:56.365941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 167/349] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:56.375192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.375850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.382030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.382752 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.383198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.383910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.384413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.384846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.451146 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.451787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.453509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.458460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.465077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.465077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.465077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.465077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.465567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.465667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-151f5f43-abbc-411b-bccd-79ab0dbf22b7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1298 microversion: 2.1 time: 0.091349 Sep 08 14:04:56.465667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 183/350] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:56.608651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.617468 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d65b1f0d-0b66-4b5a-a943-e9ecdcd44a8a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.170205 Sep 08 14:04:56.618738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 168/351] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:56.663413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.664030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.670854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.671350 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.672051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.672511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.673006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.673433 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.814178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:56.825858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1ed92bc5-5d49-4eb6-bec6-d0e167d0edaa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1554 microversion: 2.1 time: 0.166264 Sep 08 14:04:56.828308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 184/352] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:56.851067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:56.852189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:56.859159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.859654 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.860099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.860834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:56.861296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:56.861726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:56.972511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-80457028-6edb-4871-ab72-57bc13970973 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121393 Sep 08 14:04:56.972511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 169/353] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:04:56 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:57.236655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0f14b398-8afe-4bf5-ae70-4827a2526b87 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:57.237496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0f14b398-8afe-4bf5-ae70-4827a2526b87 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:57.295085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0f14b398-8afe-4bf5-ae70-4827a2526b87 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:57.302650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0f14b398-8afe-4bf5-ae70-4827a2526b87 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1215 microversion: 2.1 time: 0.070741 Sep 08 14:04:57.303217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 185/354] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:57 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:57.377887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:57.378605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:57.388882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.389380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.390042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.390951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.391602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.392252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.396059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:57.480534 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:57.489196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cad87db4-0067-4c41-ba83-4378c9362e3b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1130 microversion: 2.1 time: 0.116730 Sep 08 14:04:57.490362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 170/355] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:57 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1130 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:57.493466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:57.494474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:57.502836 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.503669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.507980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.507980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.507980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.507980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.595953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:57.619725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f27d5152-e162-4a72-9e1f-47cfaba012a5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1298 microversion: 2.1 time: 0.136230 Sep 08 14:04:57.620823 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 186/356] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:57 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:57.643389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:57.644001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:57.650984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.651457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.651891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.653170 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:57.653621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:57.654042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:57.775707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:57.808004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:57.816101 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3a457e04-2ce4-45de-a356-a5251db2f2f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.176422 Sep 08 14:04:57.817305 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 171/357] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:57 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:58.301691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57436947-9181-4656-8f1a-651b365e68bb", "tag": "03f5ab8d-d0a4-468c-b74c-c7f792d4bcea"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:58.312039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.315108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.315108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.329043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:58.330542 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:58.342821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] Creating event network-changed:03f5ab8d-d0a4-468c-b74c-c7f792d4bcea for instance 57436947-9181-4656-8f1a-651b365e68bb on hv-cinder-85646 Sep 08 14:04:58.343090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.344058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.344864 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.345823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.346446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.346871 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.351422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-1329d8f8-5ef6-4578-9ffd-1f1f253d87f9 req-b23efb4d-d071-4354-837d-516743c831c3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053311 Sep 08 14:04:58.352223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 187/358] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:58.422557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:58.432566 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a4768bee-ae7a-47ef-9164-5814ab2c9a94 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1219 microversion: 2.1 time: 0.109105 Sep 08 14:04:58.433419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 172/359] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:58 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:58.518968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:58.519993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:58.526532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.527716 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.528425 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.529385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.529868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.530322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.601715 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:58.625428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9edeba31-65d6-4111-98fb-ce14f21195b1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1186 microversion: 2.1 time: 0.110766 Sep 08 14:04:58.640882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 188/360] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:58 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1186 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:58.656837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:58.664843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:58.674178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.674683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.675134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.675854 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.678002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.680174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.771505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:58.784690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f2024abc-4e7c-4d8a-a307-3deb2cf63837 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1306 microversion: 2.1 time: 0.134182 Sep 08 14:04:58.800998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 173/361] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:58 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:58.861078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:58.861078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:58.868501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.873860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.873860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:58.873860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:58.873860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:58.874257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.020543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:59.029190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e4e6c8aa-ef62-452a-9724-7fff7254d65d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1357 microversion: 2.1 time: 0.177154 Sep 08 14:04:59.044859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 189/362] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:58 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:59.458066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:59.459130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:59.467339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.469599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.469599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.470476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.471307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.471949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.575905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:59.584708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-08d2b724-9aa5-406e-91de-5f8af82c7b90 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1211 microversion: 2.1 time: 0.130691 Sep 08 14:04:59.585302 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 174/363] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:59 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:59.666390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:59.669189 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:59.676748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.677572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.678229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.679696 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.680766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.681645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.803363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:59.811798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:59.812814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:59.818548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-20e4295d-24f3-4f46-a7de-4a0d6d8dfaaf tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1186 microversion: 2.1 time: 0.155868 Sep 08 14:04:59.819957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 190/364] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:59 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1186 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:59.821550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.822304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.822945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:59.823922 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:59.825094 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:59.825847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.044248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:00.058083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-acd27272-1179-450e-9436-38d5944badeb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.250365 Sep 08 14:05:00.072555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.072555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:00.081178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 175/365] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:59 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:00.085532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.086099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.086556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.089289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.090203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.096303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.310124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:00.331526 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a5af3733-4786-415b-9602-aed785682b49 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1548 microversion: 2.1 time: 0.282029 Sep 08 14:05:00.332430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 191/366] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1548 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:00.374041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.375193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:00.383085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.384032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.384725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.386288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.387774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.389113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.567369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:00.577072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-42efb397-dae4-4521-bfee-68ea85ef42c9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1548 microversion: 2.1 time: 0.208006 Sep 08 14:05:00.577650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 176/367] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:00.600743 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.609628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:00.612418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Searching by: {'deleted': False, 'project_id': '9aa00aef04784c1ea61221c69e872045'} {{(pid=128400) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 14:05:00.623411 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.624403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:00.625294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.625856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.626307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.627057 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.627778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.628459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.630850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.631343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.631800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.632533 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.633016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.633420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.729310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:00.748465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.multi_cell_list [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128400) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 14:05:00.756391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d4691693-3969-4cfd-ad10-5fa91f8fd48a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1267 microversion: 2.1 time: 0.121728 Sep 08 14:05:00.758274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 177/368] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:00.858561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.859290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:00.873630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6fe37331-39ae-410a-be4a-2269bbbcf010 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.278251 Sep 08 14:05:00.874996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 192/369] 10.222.0.97 () {58 vars in 1125 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:00.875115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.875115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.875278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.876131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.877267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.877267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.892176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:00.892587 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:00.900190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.900702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.901265 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:00.902273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:00.902736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:00.903169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.037403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:01.050408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-92b10694-68be-4a3b-96e4-ff316b67e783 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1204 microversion: 2.1 time: 0.196640 Sep 08 14:05:01.051564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 178/370] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1204 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:01.092512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:01.093154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:01.107218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:01.109273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:01.112720 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.113783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:01.114430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:01.116448 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.126681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:01.134741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:01.138153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-05af7265-b9a3-4a2d-a16c-1cb9ccf2855d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1548 microversion: 2.1 time: 0.255252 Sep 08 14:05:01.153154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 193/371] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:00 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1548 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:01.302149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:01.321535 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-af8c10b0-ee39-4c89-a735-5afa4b8bcc1d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.236499 Sep 08 14:05:01.329860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 179/372] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:01 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:01.781415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:01.782030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:01.788814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:01.789277 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:01.789714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.790459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:01.790910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:01.791391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.856792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:01.864779 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-56724e0e-8526-4fa4-9143-7f62b61208fb tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1267 microversion: 2.1 time: 0.089370 Sep 08 14:05:01.865365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 194/373] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:01 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:01.922599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:01.934421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:01.935246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:01.935853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:01.949714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] Creating event network-changed:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:05:01.954936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-2d3023eb-0731-4fa7-bb65-5e2da824fab8 req-c6436739-4cbd-4f54-8295-c68fee1576a9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036760 Sep 08 14:05:01.955682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 180/374] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:02.082553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:02.084047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:02.087474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:02.093693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.094344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.094943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:02.095797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.097452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.098056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:02.194548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:02.203460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-caa8966f-a0ba-4bf6-9156-096886343b28 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1204 microversion: 2.1 time: 0.127852 Sep 08 14:05:02.204102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 195/375] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:02 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:02.347242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:02.348321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:02.357470 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.358159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.365567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:02.365567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.365567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.365567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:02.567626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:02.578310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5778a413-d602-4a09-8c2c-e3a7a78ef381 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.236407 Sep 08 14:05:02.578903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 181/376] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:02 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:02.888581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:02.889449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:02.907239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.908558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.908558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:02.909175 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:02.909640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:02.910124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.003975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:03.013851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5e64794c-71c8-4b83-b691-3d0e0c7914d6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1273 microversion: 2.1 time: 0.129787 Sep 08 14:05:03.014487 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 196/377] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:02 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:03.229069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:03.229618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:03.237653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.238413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.239000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.239906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.240404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.243764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.434194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bfe257c-342a-4fea-ba93-21e1cc119ae5"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:03.436844 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:03.445114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.447387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.447387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.447387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.447387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.447713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.476609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:03.487502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-676952c6-4035-4d76-8ab8-bd063a09ab08 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.260722 Sep 08 14:05:03.487502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 182/378] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:03 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:03.602430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:03.603276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:03.610086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.610723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.611727 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.612722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:03.613262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:03.613760 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:03.773487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:03.782883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e548fbab-7e41-4d7b-b7db-246e8013c2d8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.184517 Sep 08 14:05:03.798678 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 183/379] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:03 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:04.046925 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:04.047903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:04.055145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.055865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.056482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.057512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.058946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.059670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.126595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:04.137414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-57c0570f-6ee0-4bd1-9c84-c7c23ee795c4 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1273 microversion: 2.1 time: 0.094835 Sep 08 14:05:04.138149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 184/380] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:04 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:04.452573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ae134408-954a-4389-b1b0-0cd6173dc28f tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.029042 Sep 08 14:05:04.453135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 197/381] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:05:03 2022] POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments => generated 194 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:04.514278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:04.515046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:04.525727 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.526242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.526730 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.528886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.529363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.529799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.567236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:04.581585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.582371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.583096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.598793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] Creating event network-changed:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:05:04.608366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-58dc326a-2c96-4798-b729-9d5797a6c182 req-5a1bffc3-bbdf-46ce-97f3-f26ca501404c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063486 Sep 08 14:05:04.609430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 198/382] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:04.711357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:04.720810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da5967cf-c749-4bd8-9e8f-8efc9b0b8cfd tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.211897 Sep 08 14:05:04.721530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 185/383] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:04 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:04.809315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:04.810336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:04.817052 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.817518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.817959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.818929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:04.819386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:04.819820 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:04.974807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:04.984004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ad3c29ab-1d43-4138-ac59-2fea1079a510 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.180131 Sep 08 14:05:04.985080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 199/384] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:04 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:05.162081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:05.162698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:05.169535 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.170025 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.170472 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.171230 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.171695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.172127 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.322497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:05.330968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-479ed68f-4104-4aa0-96ee-937afe5238ac tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.172795 Sep 08 14:05:05.331559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 186/385] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:05 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:05.744114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:05.744754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:05.751649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.752168 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.752636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.753384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:05.754030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:05.754298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:05.890928 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:05.899059 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d8c4d88b-ee0b-4165-add7-149d66ab7d52 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.158833 Sep 08 14:05:05.899652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 200/386] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:05 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:06.007471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:06.008251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:06.017353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.018290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.018999 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.019966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.020670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.021369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.039911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:06.200549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:06.205669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:06.218009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-92223597-a471-45b6-887f-01eae04da044 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.214757 Sep 08 14:05:06.235203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 187/387] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:06 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:06.354109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:06.354721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:06.365873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.366589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.367189 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.368017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.368512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.368943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.507302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:06.515212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-205617cf-d044-49a1-b86a-2c40fdc4a92f tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.164884 Sep 08 14:05:06.516019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 201/388] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:06 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:06.924232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:06.924868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:06.937382 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.938297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.938817 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:06.939519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:06.939982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:06.940443 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.114700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:07.122675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8d72330f-e9c9-4adb-9a74-c371aaacb8d3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.203175 Sep 08 14:05:07.123269 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 188/389] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:06 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:07.245087 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:07.245999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:07.253461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.253955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.254399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.255139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.255598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.256024 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.299987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=28 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:07.400963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6115d88f-505f-4f62-ae32-af64804441d7", "tag": "e6077910-3956-47f1-937a-761ff30736d9"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:07.410470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:07.413361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.413851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.414419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.419399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-24fd51f1-5e49-4f1f-b754-932a1078cb14 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.178336 Sep 08 14:05:07.420224 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 202/390] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:07 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:07.434814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] Creating event network-changed:e6077910-3956-47f1-937a-761ff30736d9 for instance 6115d88f-505f-4f62-ae32-af64804441d7 on hv-cinder-85646 Sep 08 14:05:07.439723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-8283d1d9-fb15-4b3a-b2e8-fd2f5759ebaf req-995f94fe-b8c5-4594-b469-277d762d2d98 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042893 Sep 08 14:05:07.440669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 189/391] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:07.538620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:07.539254 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:07.545439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.545919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.546353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.547041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:07.547494 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:07.547923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:07.687610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:07.688211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c39e8cfe-47ca-4bf4-a4a1-1082dd4df0a6 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.153362 Sep 08 14:05:07.688905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 203/392] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:07 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:08.146324 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:08.147123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:08.154510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.155004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.155442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.156168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.156624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.157044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.295910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:08.303988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6bbe1d63-ee41-4407-a516-491b2b4569ea tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.162500 Sep 08 14:05:08.304608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 190/393] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:08 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:08.446450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:08.448994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:08.456345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.457376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.458038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.459170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.459883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.475075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "name": "network-vif-plugged", "status": "completed", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:08.476121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.481995 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.482496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.482926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.495002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] Creating event network-vif-plugged:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:05:08.500617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-585087e9-1354-47e1-8011-2adb2c47f5a6 req-6b6dfa24-052b-48cd-96fa-0fc82b2f8285 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Sep 08 14:05:08.506976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 191/394] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:08.638302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:08.646489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2ca9eab0-ced0-45fc-bfcc-cd0b01f33688 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.206438 Sep 08 14:05:08.657418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 204/395] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:08 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:08.712105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:08.712838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:08.719847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.720371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.720801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.722540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:08.722540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:08.722540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:08.864010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:08.871936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-37f18fdc-2495-41a0-a8a2-f665a57203ae tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.164019 Sep 08 14:05:08.872622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 192/396] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:08 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:09.330701 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:09.331350 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:09.337431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.337916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.338351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.339048 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.339503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.339927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.478138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:09.485702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d64d348f-9012-4c74-90e0-1f1bb8bcbdba tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.159973 Sep 08 14:05:09.496489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 205/397] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:09 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:09.670661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:09.671246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:09.678021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.678509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.678943 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.679661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.680125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.680582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.833905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:09.841351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-41523080-3b0d-4e10-8712-91e77f803678 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.175114 Sep 08 14:05:09.847690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 193/398] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:09 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:09.895436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:09.896055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:09.902473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.902954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.903388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:09.904078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:09.904558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:09.904980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.042851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:10.051872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-87c7d9cd-4f0c-496a-9a9d-19fd9ecdc510 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.160277 Sep 08 14:05:10.052472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 206/399] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:09 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:10.509934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:10.510563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:10.517776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.518275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.518712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.519498 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.519961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.520422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.667187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:10.675182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7871c8d3-8107-4ede-aa36-3128d5fe2f82 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.169389 Sep 08 14:05:10.675851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 194/400] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:10 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:10.865819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:10.866458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:10.868866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:10.874720 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.875217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.875656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:10.876391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:10.876850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:10.877409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.030411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.038265 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bc02f82c-bfcf-424a-951a-a103e06329d3 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.176422 Sep 08 14:05:11.038857 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 207/401] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:10 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:11.075534 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:11.076158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:11.082648 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.083132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.083564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.084323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.084800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.085227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.236500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.245773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-45c0b776-ee81-4b6d-b52e-b31531effd9a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.174324 Sep 08 14:05:11.247260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 195/402] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:11 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:11.700375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:11.701303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:11.707744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.708292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.708730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.709477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:11.710017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:11.710678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:11.853533 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:11.862763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f50120de-f5b0-4918-8bd9-3491153d42c3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.167780 Sep 08 14:05:11.863372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 208/403] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:11 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:12.062039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:12.062664 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:12.068853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.069332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.069759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.070460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.070892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.071314 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.215285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.223107 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-310be35e-18fd-4ac0-b253-6b4426b4a775 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1371 microversion: 2.1 time: 0.165675 Sep 08 14:05:12.223690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 196/404] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:12 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:12.271043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:12.271700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:12.278347 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.278839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.279280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.279986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.280470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.280898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.422767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:12.425226 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:12.432565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d6498804-96ed-4e46-abbe-e6e7288e7c79 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.165492 Sep 08 14:05:12.433149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 209/405] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:12 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:12.886916 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:12.888018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:12.893753 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.894257 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.894700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:12.895444 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:12.895906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:12.896376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.039274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.056393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-53882246-009d-4c8e-bafa-29aa383579de tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.165411 Sep 08 14:05:13.056393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 197/406] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:12 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:13.246654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:13.247173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:13.254781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.255269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.255704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.256476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.256970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.257396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.360176 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6115d88f-505f-4f62-ae32-af64804441d7", "name": "network-vif-plugged", "status": "completed", "tag": "e6077910-3956-47f1-937a-761ff30736d9"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:13.373675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.374265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.374775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.387764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] Creating event network-vif-plugged:e6077910-3956-47f1-937a-761ff30736d9 for instance 6115d88f-505f-4f62-ae32-af64804441d7 on hv-cinder-85646 Sep 08 14:05:13.392990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-cbc1b306-cd7b-43f8-9edc-47e4c53cb2ef req-812c3c3b-a6c0-4836-acfd-b3295911f4be service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037396 Sep 08 14:05:13.393615 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 198/407] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:13.416059 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.424815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-94f586f1-cf39-4c8c-ba81-3ad71085fed1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1564 microversion: 2.1 time: 0.182348 Sep 08 14:05:13.425424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 210/408] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:13 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:13.457244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:13.458164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:13.459315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:13.459826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:13.466399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.467051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.467158 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.467665 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.467933 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.468126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.468934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.469137 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:13.469461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.469781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:13.469950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.470408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:13.590374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e4bef1a9-1082-45bc-bd24-09b6f4fdbe6f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134410 Sep 08 14:05:13.590868 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 211/409] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:05:13 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:13.668629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:13.677105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2c60f006-61a8-4b0b-a2ca-4e0781c53241 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.224030 Sep 08 14:05:13.677710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 199/410] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:13 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:13.947710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-838137787", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-23972180", "security_groups": [{"name": "tempest-secgroup-smoke-2101580619"}], "block_device_mapping_v2": [{"uuid": "7b4366b0-ec69-4165-9c7a-3118d671b122", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1825ab58-9a7f-4a28-9e67-c083bb9f8e93"}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:14.072803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] validate_networks() for [('1825ab58-9a7f-4a28-9e67-c083bb9f8e93', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:05:14.078940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:14.079558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:14.081732 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.091569 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.092068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.092538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.093249 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.093719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.094144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.514656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:14.523327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-058b21bd-2c42-4298-b21b-a9e036e0d824 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.448089 Sep 08 14:05:14.528304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 200/411] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:14 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:14.713601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:14.715080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:14.721826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.722321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.722758 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.723474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.723932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.724389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.810606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:05:14.811675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:05:14.812316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:05:14.812936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:05:14.813520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:05:14.824619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.825215 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.825577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.826325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.826786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.827231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:14.848308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:14.854042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for user 26aa79753d6e4e49ad66cc32ba786fe8 and project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:14.892962 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:14.903267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-95d4e73b-3485-4139-99e4-6bfb9e20ae42 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.194193 Sep 08 14:05:14.908326 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 201/412] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:14 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:14.925717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:05:14.927952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b4366b0-ec69-4165-9c7a-3118d671b122',volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:05:14.979451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:14.988978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:14.989451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:14.989872 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.001762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] Creating event network-changed:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:05:15.006809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-f8a16c17-19d7-4a32-a1f1-51cb8c296e1a req-d0ead5a6-c092-4864-9c64-e5b1acb92fc0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032120 Sep 08 14:05:15.007428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 202/413] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:15.458615 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7b5858c3-efee-41e7-a063-e8177e9ed927 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.514951 Sep 08 14:05:15.459437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 212/414] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:05:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:05:15.472513 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ca509f8e-1df5-4be2-8937-c372a4779494 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:15.473459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ca509f8e-1df5-4be2-8937-c372a4779494 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:15.534345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ca509f8e-1df5-4be2-8937-c372a4779494 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.542666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ca509f8e-1df5-4be2-8937-c372a4779494 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1092 microversion: 2.1 time: 0.074643 Sep 08 14:05:15.547698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:15.548681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:15.556597 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.557590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.558783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.559163 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 203/415] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:15 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1092 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:15.560018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.560733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.561273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.731639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:15.745650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-03f97639-ae0a-4da5-8cee-8c9e0674c460 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.202395 Sep 08 14:05:15.753691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 213/416] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:15 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:15.927012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:15.927704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:15.936045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.936620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.937056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:15.937757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:15.938218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:15.938668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.097372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:16.107985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-92d4c938-f1c3-420a-9ed7-baeaccaf4672 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.184970 Sep 08 14:05:16.108850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 204/417] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:15 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:16.566262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7ca4237e-b0f5-4ecd-9ff5-e8c5bebc0a76 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:16.567523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7ca4237e-b0f5-4ecd-9ff5-e8c5bebc0a76 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:16.627579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7ca4237e-b0f5-4ecd-9ff5-e8c5bebc0a76 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:16.638786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7ca4237e-b0f5-4ecd-9ff5-e8c5bebc0a76 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1092 microversion: 2.1 time: 0.077406 Sep 08 14:05:16.639475 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 214/418] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:16 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:16.769762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:16.770315 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:16.776892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.786225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.786225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.786225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:16.786225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:16.786607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:16.926102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:16.935372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d9dc4f05-8504-45c8-aaf8-f18b9c779f07 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.169766 Sep 08 14:05:16.936079 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 205/419] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:16 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:17.132703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.133278 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:17.143180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.143180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.143882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.144248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.145098 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.145534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.291167 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:17.300195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c6ff7d28-8e39-475d-b04d-6c33fdcb3c78 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.171718 Sep 08 14:05:17.300872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 215/420] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:17 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:17.663355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.663886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:17.670417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.670984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.671430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.672169 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.672668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.673118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.736954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:17.744898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-71788f6b-c1b3-4af8-a646-98f0cf0edf7c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1142 microversion: 2.1 time: 0.085482 Sep 08 14:05:17.745493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 206/421] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:17 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:17.958829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:17.959456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:17.966483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.966967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.967396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:17.968359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:17.968837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:17.969262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.115093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:18.124463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fc41b08a-9f65-487a-b192-de2b783fde6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.169310 Sep 08 14:05:18.125708 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 216/422] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:17 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:18.323724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:18.324889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:18.331441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.331918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.332556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.333254 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.333711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.334134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.488641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:18.491311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:18.498266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1b37f64a-e7ee-41a6-a5a6-4855972b0188 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1315 microversion: 2.1 time: 0.178339 Sep 08 14:05:18.498942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 207/423] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:18 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:18.525615 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:18.526278 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:18.532785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.533449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.533955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.534769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.535257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.535733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.677882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:18.686970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-63149f56-6acd-4621-8dba-484a49f11da7 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1594 microversion: 2.1 time: 0.165316 Sep 08 14:05:18.687556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 217/424] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:18 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:18.768033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:18.768714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:18.775118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.783538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.784210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.785268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:18.785536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:18.785958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:18.870230 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:18.885796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-85718897-fad5-4b4f-b02d-aaaaf23c9346 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1190 microversion: 2.1 time: 0.121663 Sep 08 14:05:18.886820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 208/425] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:18 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1190 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:19.164105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.164841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.171449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.171941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.172408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.173106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.173557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.173982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.335225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:19.346453 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-69131ca7-2263-4a6d-86b9-9d77e0f3b359 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.186316 Sep 08 14:05:19.347063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 218/426] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:19.523011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.524237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.531060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.531839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.532317 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.533035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.533496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.533920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.699165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:19.708694 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f09da046-cf3c-45d6-ae7f-f4da8f5941f7 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1464 microversion: 2.1 time: 0.189277 Sep 08 14:05:19.709531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 209/427] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:19.759852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.760576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.769133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.770694 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.770694 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.770958 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.771425 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.771856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.805196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:19.911717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:19.912365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:19.919217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.919736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.920195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.920892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:19.921349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:19.922955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:19.993272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:20.001231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b7d7a1b5-3ae6-422f-a4ee-b8d889721543 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1190 microversion: 2.1 time: 0.093567 Sep 08 14:05:20.001806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 210/428] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:19 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1190 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:20.184805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-36b78986-300c-44bd-bac4-2d1add72fa1a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 204 len: 0 microversion: 2.1 time: 0.428842 Sep 08 14:05:20.186160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 219/429] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:19 2022] DELETE /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:20.194392 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:20.195676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:20.201729 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.202758 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.203360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.204399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.205069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.205710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.210991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "name": "network-vif-plugged", "status": "completed", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:20.223634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.224273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.225684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.237113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] Creating event network-vif-plugged:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:05:20.242272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-0b4d727c-f868-4666-8f72-72262e247475 req-f3c1012a-a49e-4ffc-abf7-0e5fedfbdd0e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038309 Sep 08 14:05:20.242953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 220/430] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:20.354109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:20.362227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d6510079-9d23-4f24-8323-ca0253b0e615 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1470 microversion: 2.1 time: 0.172000 Sep 08 14:05:20.362809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 211/431] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:20 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:20.375707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:20.376700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:20.384176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.384665 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.385124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.385871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:20.386910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:20.387429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:20.543318 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:20.551634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b3a34bad-0727-475a-8c26-f027b4127b6f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.181623 Sep 08 14:05:20.552296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 221/432] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:20 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:21.024311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:21.024956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:21.036272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.036272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.036272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.036272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.036713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.036713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.103229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:21.120801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e64749a4-7690-4b5c-b843-1ffb0e4a9720 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1190 microversion: 2.1 time: 0.100306 Sep 08 14:05:21.122548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 212/433] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:21 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:21.269491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:21.280558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.281046 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.281482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.294114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] Creating event network-changed:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:05:21.299528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-767a4fd8-d59c-4743-8d35-9120b702d102 req-ffaa43f8-d643-4682-b2b6-9224170aadca service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034208 Sep 08 14:05:21.300241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 222/434] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:21.391171 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:21.392029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:21.398283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.398818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.399260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.400125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.400466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.400903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.573719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:21.582142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:21.583138 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-88750b83-3976-4be5-af8d-2d3ca1304fdc tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1470 microversion: 2.1 time: 0.196017 Sep 08 14:05:21.584127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:21.584322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 213/435] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:21 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:21.594633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.595633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.596424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.597321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:21.597945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:21.598524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:21.788315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:21.798991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-63dbf93e-5545-4380-b103-44735e1a74b4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.227127 Sep 08 14:05:21.800113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 223/436] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:21 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:22.146049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:22.146793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:22.153823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.154535 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.155033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.155800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.156370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.156860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.234006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:22.242075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-85066654-35ef-47c3-96a0-25e0fb3b95ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1198 microversion: 2.1 time: 0.100927 Sep 08 14:05:22.242663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 214/437] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:22 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:22.607446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:22.608082 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:22.614646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.615136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.615574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.616308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.616769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.617200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.756078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:22.764121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f5d02053-2fbe-4ca4-9092-72c656041fdf tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1470 microversion: 2.1 time: 0.160924 Sep 08 14:05:22.764736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 224/438] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:22 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:22.826068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:22.826693 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:22.832978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.833368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.833925 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.834594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:22.835045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:22.835467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:22.983304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:22.992990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e2b95ecc-5007-4e52-8618-559ab9c458dc tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.170946 Sep 08 14:05:22.993966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 215/439] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:22 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:23.266827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:23.267845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:23.275076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.275592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.276028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.276779 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.277290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.277711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.367486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.377045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ed22e42b-68cc-4a0a-a273-0681441d5105 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1198 microversion: 2.1 time: 0.114056 Sep 08 14:05:23.377710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 225/440] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:23 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:23.789877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:23.790491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:23.797717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.798210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.798676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.799433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:23.800750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:23.801455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:23.951674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:23.960811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-035a0349-f49c-495d-91d2-08d1fc88f63d tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1470 microversion: 2.1 time: 0.176042 Sep 08 14:05:23.973199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 216/441] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:23 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:24.019605 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:24.020748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.028603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.029212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.029726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.030531 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.031075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.031585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.297822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.313717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7af3bd52-ba32-4df3-87cf-2cd187150272 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.298356 Sep 08 14:05:24.315161 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 226/442] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:24 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:24.400971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:24.406549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.408319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.409145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.409598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.410340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.410825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.411312 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.534636 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:24.547599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e8b59366-6211-4ac9-8244-f9fa618c8100 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1208 microversion: 2.1 time: 0.150521 Sep 08 14:05:24.549182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 217/443] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:24 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1208 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:24.686620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-47291856"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:24.687583 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.696500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.697840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.698938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.700194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.701154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.701996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.874681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.893334 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6115d88f-505f-4f62-ae32-af64804441d7", "name": "network-vif-deleted", "tag": "e6077910-3956-47f1-937a-761ff30736d9"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:24.916033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.network.security_group_api [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Adding security group 118f07d5-0c15-4623-82f6-18df9002a88f to port d42836f7-59df-4047-abf1-f2202598649e Sep 08 14:05:24.921628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.922445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.923075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.943080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] Creating event network-vif-deleted:e6077910-3956-47f1-937a-761ff30736d9 for instance 6115d88f-505f-4f62-ae32-af64804441d7 on hv-cinder-85646 Sep 08 14:05:24.958750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-1ea1c15f-55f6-4d7d-b9f5-ce83123ac396 req-aad8fe39-036f-4b71-b271-d0a50940128f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072770 Sep 08 14:05:24.960204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 218/444] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:25.003773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.004655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.014637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.015728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.016296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.018183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.019030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.019694 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.167726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.177463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1f2a6cd7-dc61-46f1-b4e2-51e9debc609a tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1428 microversion: 2.1 time: 0.178953 Sep 08 14:05:25.178077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 219/445] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:24 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:25.347607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.348264 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.357175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.358461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.358905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.359686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.360404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.361037 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.517898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c07267a4-0f24-495e-bbd4-333780cedb46 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action" status: 202 len: 0 microversion: 2.1 time: 0.839516 Sep 08 14:05:25.524758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 227/446] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:05:24 2022] POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:25.528808 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.529431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.539079 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.546784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.547405 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.547943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.548963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.549520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.550064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.598013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.612493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.622189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-809efacc-cab5-406d-9025-0f91a56ac990 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1260 microversion: 2.1 time: 0.278542 Sep 08 14:05:25.622942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 220/447] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:25 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:25.632527 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:25.651528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.652515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.652661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.681625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] Creating event network-changed:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:05:25.692243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-fabf5842-b4d0-4e6a-8d3d-8c17617bfe1f req-c48dbf76-942c-45ab-9f4a-e8317d9522cb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067678 Sep 08 14:05:25.693355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 221/448] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:25.701573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:25.703174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:25.712523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.714221 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.716862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.717885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:25.718558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:25.719178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:25.785454 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.797459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4380be49-eb0a-4a8a-8a92-688ad39ec253 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1639 microversion: 2.1 time: 0.273660 Sep 08 14:05:25.798410 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 228/449] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:25 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1639 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:25.921454 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:25.934573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4a4f39dc-ffba-4d5c-ba3f-029951aeacf6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1276 microversion: 2.1 time: 0.238849 Sep 08 14:05:25.935728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 222/450] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:25 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:26.210491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.212823 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.235953 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.236608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.237929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.238929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.240551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.242802 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.317610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.318188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.318842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.319790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lazy-loading 'fault' on Instance uuid 6115d88f-505f-4f62-ae32-af64804441d7 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:26.370286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:26.380748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9ad71293-c6d2-4a83-8db3-1b2de938723e tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1305 microversion: 2.1 time: 0.183197 Sep 08 14:05:26.384316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 229/451] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1305 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:26.647724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.648395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.655179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.655681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.656194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.657108 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.657779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.663687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.831009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:26.840742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7393b6ec-f528-4b5c-8b09-a4a29569cbbe tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1443 microversion: 2.1 time: 0.197754 Sep 08 14:05:26.841480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 223/452] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1443 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:26.867847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.869599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.873407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=8 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:26.883072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.884063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.885041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.886546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.887532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.888491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.972377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.984696 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.992510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.993306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.993898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.994850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.996545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.997827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.165532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.176256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-29e5f5e7-b397-404a-94a9-d40b039cccd3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1443 microversion: 2.1 time: 0.314830 Sep 08 14:05:27.186385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 230/453] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1443 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:27.219573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.227366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8ac9f668-1d5f-4abd-ab1d-7bc5c100a762 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1276 microversion: 2.1 time: 0.263567 Sep 08 14:05:27.243095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 224/454] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:27.422850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:27.426100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:27.434448 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4be2d8-2899-4377-850f-21ed875432ab", "tag": "7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:27.435323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.435910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.436491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.437341 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.437863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.438600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.446685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.447178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.447857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.460743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] Creating event network-changed:7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04 for instance fa4be2d8-2899-4377-850f-21ed875432ab on hv-cinder-85646 Sep 08 14:05:27.466873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-3d898d1b-598c-4619-9443-3c3b4c7df6c6 req-55ab25f4-2341-4d80-afbe-c8c13e91a87e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038453 Sep 08 14:05:27.467104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 225/455] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:27.487074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:27.493542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.493542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.493542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.493542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lazy-loading 'fault' on Instance uuid 6115d88f-505f-4f62-ae32-af64804441d7 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:27.574858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187691a095d94a6591ff94eeef7c41c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a212684b7034dd2a02eff9cc2a3dbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:27.584755 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-77ad8f71-1702-4cf2-862f-448d7bbceb75 tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 200 len: 1305 microversion: 2.1 time: 0.168350 Sep 08 14:05:27.585341 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 231/456] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:27 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:28.251150 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:28.252041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:28.259858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.260458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.260960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.261787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.262310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.262797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.283471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:28.621580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:28.628465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] [instance: 6115d88f-505f-4f62-ae32-af64804441d7] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:28.629450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.630011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.630476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.631166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.631634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.632067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.648749 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] HTTP exception thrown: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Request method failure captured: Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 HTTP/1.1 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfaFbTtoBLb69DEZlWpHqqN5KBtnrd927rOZ81FDhX73CJ8nHrEeWdK_QgahI1cbOiVlOU110z9y8QnIPXFiaSltad8Su6g40oEMvxlk1Z38p8xxC4QDqZ8dgkmZ1TWImWIAE0pY8D77J9y25gzuixCWlDeIEI4an9QLKzKHqmEURvk Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 9a212684b7034dd2a02eff9cc2a3dbd8 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesNegativeTest-438196462 Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:05:28.650744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9a212684b7034dd2a02eff9cc2a3dbd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9a212684b7034dd2a02eff9cc2a3dbd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9a212684b7034dd2a02eff9cc2a3dbd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9a212684b7034dd2a02eff9cc2a3dbd8", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesNegativeTest-438196462 Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 9a212684b7034dd2a02eff9cc2a3dbd8 Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesNegativeTest-438196462 Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesNegativeTest-438196462-project Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 187691a095d94a6591ff94eeef7c41c7 Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesNegativeTest-438196462-project Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. Sep 08 14:05:28.653007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '6115d88f-505f-4f62-ae32-af64804441d7'} Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:28.657455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. Sep 08 14:05:28.659104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:28.660183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] Returning 404 to user: Instance 6115d88f-505f-4f62-ae32-af64804441d7 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:28.660183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d904b220-6dae-41fd-8d3c-b972b007f7de tempest-VolumesNegativeTest-438196462 tempest-VolumesNegativeTest-438196462-project] 10.222.0.97 "GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7" status: 404 len: 111 microversion: 2.1 time: 0.035203 Sep 08 14:05:28.660183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 232/457] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:28 2022] GET /compute/v2.1/servers/6115d88f-505f-4f62-ae32-af64804441d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:28.691833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:28.706175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e3bd99cd-809c-4094-890d-24482460f19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.459099 Sep 08 14:05:28.708327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 226/458] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:28 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:29.738744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:29.739366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:29.746996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:29.747394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:29.748219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:29.749283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:29.749758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:29.750177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.025512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:30.043874 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1e159298-6952-4950-a421-70df56addf1c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.309263 Sep 08 14:05:30.054149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 233/459] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:29 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:30.181493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:30.208544 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:30.208544 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:30.208544 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.227045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] Creating event network-changed:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:05:30.243558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-461ab160-a44b-48be-b00c-66a0a9441787 req-6dc69752-5f5b-41cd-87d7-f59cbb6bb6a0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069181 Sep 08 14:05:30.245951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 227/460] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:31.081072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:31.081770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:31.098197 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.098705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.099149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.099869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.100361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.100800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.290112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:31.298753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ca995f87-bbed-4693-8e5e-3380b41f8f17 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.221447 Sep 08 14:05:31.299447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 234/461] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:31 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:32.327422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:32.328512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:32.337356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.338246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.339017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.340366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.341217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.341762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.526509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:32.535860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-99ac75bd-a8dd-45e1-9907-d611e0ea28a0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.214045 Sep 08 14:05:32.536770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 228/462] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:32 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:33.561901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:33.562581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:33.569925 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.570429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.575968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.575968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:33.575968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:33.575968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:33.740278 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:33.748569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-46771d2d-493b-45d8-b0b3-7c0e4c788856 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.191216 Sep 08 14:05:33.749159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 235/463] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:33 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:34.773471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:34.774304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:34.781752 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.782243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.782681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.783385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:34.783845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:34.784313 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:34.937158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:34.945596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5106ad4b-5208-45cc-92d5-4d48608665ba tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.176259 Sep 08 14:05:34.946190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 229/464] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:34 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:35.970838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.971566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.978826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.979332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.979770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.981300 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.981780 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.982217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.163862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:36.173947 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8f1f3ca5-a289-4dbc-a23a-04ac89f697a7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.208499 Sep 08 14:05:36.174552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 236/465] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:37.200598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:37.201189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:37.207825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.208349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.208784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.209476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:37.209926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:37.210345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.387987 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.397415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7f6232b2-f544-432d-81a9-c0dddfd0dfe5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.200681 Sep 08 14:05:37.398036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 230/466] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:37 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:38.424590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.430627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.435020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.435599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.436076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.436876 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.437431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.437901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.601808 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.610137 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f4608bdf-d512-457b-87a7-0281eb1080d4 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.191592 Sep 08 14:05:38.610736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 237/467] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:39.633866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.634451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.641559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.642048 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.642479 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.643183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.643637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.644059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.788364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:39.797600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1958eff5-38dc-46fd-bdf1-2ce216a85f4a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.167531 Sep 08 14:05:39.798122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 231/468] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:40.678306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4be2d8-2899-4377-850f-21ed875432ab", "name": "network-vif-plugged", "status": "completed", "tag": "7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:40.689703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.690306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.690741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.703342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] Creating event network-vif-plugged:7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04 for instance fa4be2d8-2899-4377-850f-21ed875432ab on hv-cinder-85646 Sep 08 14:05:40.708707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-3b5f32bf-85f9-427c-a7cf-598119a6eb3e req-e8cde15d-6676-4c20-96cb-03038c1adf2f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Sep 08 14:05:40.709383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 238/469] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:40.822172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:40.822879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:40.830917 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.831533 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.831971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.832723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:40.833207 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:40.833879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:40.993387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:41.002474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1d36dc1b-71f0-48e3-9cb6-be2cecd087a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.184458 Sep 08 14:05:41.008369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 232/470] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:40 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:42.028519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:42.029240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:42.035675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.036197 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.036641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.037340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:42.037795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:42.038222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:42.193018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:42.203224 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5b42eedb-edaa-49f0-818a-f92d49caaeac tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.180007 Sep 08 14:05:42.205434 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 239/471] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:42 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:43.227031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:43.227653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:43.234662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.235161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.235605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.236399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:43.236862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:43.237296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:43.390021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:43.397896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2d71b94e-ab72-4f75-84e8-7701c8d85e35 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1264 microversion: 2.1 time: 0.174764 Sep 08 14:05:43.398477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 233/472] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:43 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:44.420758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.421474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.428881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.429409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.429862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.430566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.431020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.431469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.572682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:44.581728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-de2a3dd0-5a61-42b0-89c7-b64c60480b4f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1451 microversion: 2.1 time: 0.164841 Sep 08 14:05:44.582261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 240/473] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:44.608462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:44.609075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:44.616890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=70 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:44.623621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.628848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.628848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.628848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:44.628848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:44.629260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:44.759361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:44.767830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bd627a30-002d-470d-933f-7fcc53176523 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1451 microversion: 2.1 time: 0.164746 Sep 08 14:05:44.768450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 234/474] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:44 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:47.117142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4be2d8-2899-4377-850f-21ed875432ab", "tag": "7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:47.127222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:47.127723 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:47.128169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:47.141742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] Creating event network-changed:7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04 for instance fa4be2d8-2899-4377-850f-21ed875432ab on hv-cinder-85646 Sep 08 14:05:47.147019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-efc8fe3e-3495-48db-9604-c75018ce772d req-a8f395e8-9b64-4f57-9975-891e2c3ae52c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033600 Sep 08 14:05:47.147879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 241/475] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:56.911258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:56.911887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.914003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.914668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=47 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.920286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.920785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.921226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.921939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.922393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.922823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.949703 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-06165994-e463-4d78-b066-2f4008920067 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/ips" status: 200 len: 149 microversion: 2.1 time: 0.042521 Sep 08 14:05:56.950298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 235/476] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:05:56 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:56.963697 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:56.966374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.974639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.975327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.976058 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.977117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.977689 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.978297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.984014 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=74 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.984403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:56.984945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:56.992440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.992938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.993565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:56.994704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:56.995216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:56.996466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: POST /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/os-volume_attachments HTTP/1.1 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 74 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:05:57.078986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {"volumeAttachment": {"volumeId": "a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1"}} Sep 08 14:05:57.082545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'server_id': '57436947-9181-4656-8f1a-651b365e68bb', 'body': {'volumeAttachment': {'volumeId': 'a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1'}}} Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.085118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:57.088286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 400 to user: Invalid volume: volume a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 is already attached to instances: 8ff597ca-3f06-47d9-92c0-b3fc4522c030 {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e23fbb1e-58b9-4bc2-b8f0-10c86c304c8f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118993 Sep 08 14:05:57.091153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 242/477] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:05:56 2022] POST /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:05:57.092539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.092539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.097414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.097941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.098388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.099099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.099553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.099981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.129133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:57.152233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lazy-loading 'services' on Instance uuid 7fec36d5-04f6-46ec-8406-004966e4e97b {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:57.510635 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-eab06838-ff72-4a3e-84a9-60df460a7968 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments/f361d291-0abc-45e8-a3f2-1589787700b3" status: 202 len: 0 microversion: 2.1 time: 0.532860 Sep 08 14:05:57.517084 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 236/478] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:56 2022] DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments/f361d291-0abc-45e8-a3f2-1589787700b3 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:05:57.602498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-22e9d93a-6a93-4a41-8142-5720f4f20059 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 204 len: 0 microversion: 2.1 time: 0.517922 Sep 08 14:05:57.603138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 243/479] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:57 2022] DELETE /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:05:57.613100 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:57.613815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:57.620396 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.621459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.621899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.622616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:57.623077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:57.623505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:57.793573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:57.803351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1d42173a-34c3-43b1-99ee-c1a8a219cdd8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1679 microversion: 2.1 time: 0.194809 Sep 08 14:05:57.803944 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 237/480] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:57 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:58.828026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:58.828801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:58.835991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.836519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.836952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.837660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.838112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.838636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.025577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:59.034145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d9bea48a-c786-4ee6-adc4-1e4cb2468ed9 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1679 microversion: 2.1 time: 0.210412 Sep 08 14:05:59.034727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 244/481] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:58 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:00.071950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.072688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.079687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.080226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.080670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.081393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.081858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.082290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.326553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:00.326553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-04cd4ca1-7199-4ba0-b000-7784a976d49d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1679 microversion: 2.1 time: 0.169571 Sep 08 14:06:00.326553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 238/482] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:01.257694 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57436947-9181-4656-8f1a-651b365e68bb", "name": "network-vif-deleted", "tag": "03f5ab8d-d0a4-468c-b74c-c7f792d4bcea"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:01.263849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:01.267991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:01.267991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:01.269462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.269947 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.270374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.274641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.275507 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.276256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.277823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.278536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.279242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.283187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] Creating event network-vif-deleted:03f5ab8d-d0a4-468c-b74c-c7f792d4bcea for instance 57436947-9181-4656-8f1a-651b365e68bb on hv-cinder-85646 Sep 08 14:06:01.288490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-c025a8e9-056f-43d0-8c6d-abc5ac0cae8b req-5235a781-49cf-4128-921b-213028ca3818 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034517 Sep 08 14:06:01.289111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 245/483] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:01.364265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:01.375284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-72194b16-429a-4c3e-a81e-a61f9ca5cc31 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1612 microversion: 2.1 time: 0.113428 Sep 08 14:06:01.376089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 239/484] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:01 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:01.876216 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:01.884333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.885086 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.885774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.919336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Going to try to stop instance {{(pid=128400) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 14:06:02.148302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-83fba70f-758f-428d-a516-933e34904fec tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action" status: 202 len: 0 microversion: 2.1 time: 0.276716 Sep 08 14:06:02.153013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 246/485] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:01 2022] POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:02.158506 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:02.159171 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.165554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.166678 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.167138 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.167907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.168655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.169020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.321853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:02.330793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2a5dc72b-8d7b-4d2d-b903-a0f6734b3465 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.176046 Sep 08 14:06:02.331343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 240/486] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:02 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:02.400321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:02.401204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.410323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.414743 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.415261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.416013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.416671 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.417249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.468901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.469813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.471809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.472682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'fault' on Instance uuid 57436947-9181-4656-8f1a-651b365e68bb {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:02.544557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:02.554961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-81610dc2-584d-4785-a661-d7b190533411 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 200 len: 1330 microversion: 2.1 time: 0.159560 Sep 08 14:06:02.555811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 247/487] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:02 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 1330 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:03.364747 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.365416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:03.372489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.372978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.373421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.374137 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.374627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.375061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.537706 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:03.546655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d127e9ca-fed3-42fe-bc8d-b422692aaa75 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.186060 Sep 08 14:06:03.547243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 241/488] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:03 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:03.582028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.582648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:03.589367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.590608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.591069 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.591795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:03.592288 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:03.592716 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.607440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb HTTP/1.1 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:06:03.609037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:06:03.611731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '57436947-9181-4656-8f1a-651b365e68bb'} Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:03.613088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:06:03.615205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:06:03.616946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:03.616946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-174630d8-2bfb-4dad-b344-ee3195baf946 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 404 len: 111 microversion: 2.1 time: 0.032864 Sep 08 14:06:03.616946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 248/489] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:03 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:06:03.619726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fe1a7352-cedb-49a4-9619-5a8ca48017e7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '.version_select at 0x7f7f8c81f280>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:03.722959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fe1a7352-cedb-49a4-9619-5a8ca48017e7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278214401" status: 202 len: 0 microversion: 2.1 time: 0.107064 Sep 08 14:06:03.723561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 242/490] 10.222.0.97 () {58 vars in 1218 bytes} [Thu Sep 8 14:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278214401 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:04.569079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.569692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.577346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.577846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.578268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.579075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.579495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.579919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.616692 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.617286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.624871 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.625372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.625809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.626570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.627039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.627466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.714023 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'services' on Instance uuid 8ff597ca-3f06-47d9-92c0-b3fc4522c030 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:04.728299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:04.736543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9f205b36-947a-4fc1-a769-17cf16ef9026 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.171204 Sep 08 14:06:04.745103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 249/491] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:04 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:04.950793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ec3b1259-29f0-4726-8658-3277db3ecb32 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments/a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1" status: 202 len: 0 microversion: 2.1 time: 0.338405 Sep 08 14:06:04.951475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 243/492] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:06:04 2022] DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments/a91b2ee8-533a-4ea8-a3fc-d2dcc6ad3df1 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:04.960111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.962330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.968334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.968827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.969275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.970026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.970489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.970921 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.001742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ed32b694-27af-4c88-86de-ab45b6a1465c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Sep 08 14:06:05.002520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 250/493] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:04 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:05.761752 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:05.762438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:05.768708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.769194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.769630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.770366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.770846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.771274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.907927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:05.916201 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c032343e-cce6-4960-968f-e9f408b78c62 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.158926 Sep 08 14:06:05.923841 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 244/494] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:05 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:06.015421 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.017719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.024415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.024907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.025348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.026057 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.026515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.027579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.057898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-608c64b0-e8d8-437f-8ebe-746f26a68e93 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047242 Sep 08 14:06:06.058573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 251/495] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:06.104309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:06.106666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.112734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.113214 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.113650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.114342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.114795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.115219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.348742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ddec4299-ca5f-457f-bc2f-0659f283e6d8 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action" status: 202 len: 0 microversion: 2.1 time: 0.248595 Sep 08 14:06:06.349506 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 245/496] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:06 2022] POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:06.357736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.358394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.364666 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.365153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.365583 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.366270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.366721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.367139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.526624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:06.537251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-35ebeebc-6973-4acc-bfce-229206bbe4b1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1750 microversion: 2.1 time: 0.183310 Sep 08 14:06:06.538757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 252/497] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:06.949267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.950590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.959272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.960047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.960555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.961504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.962002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.962428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.071687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.075358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.086955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.086955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.086955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.086955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.087275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.087275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.132767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-12b485b3-83ef-4e3f-8a67-6aec7bb8bc34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065430 Sep 08 14:06:07.133873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 253/498] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:06:07 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 14:06:07.137413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:07.149792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-151a0104-74de-43d5-bdfd-fd213c49a3fb tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.207671 Sep 08 14:06:07.150554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 246/499] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:07.207845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.208382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.214914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.215401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.215832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.216613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.217105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.217531 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.246785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:06:07.564096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.565042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.574265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.589655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.589655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.589655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.589655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.590447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.752724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:07.763482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bd01d084-bb70-4d61-a013-272941e749d9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.205618 Sep 08 14:06:07.764108 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 247/500] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:07 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:07.786047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3064ac8b-60ac-4ec4-819e-fd19196e63bc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 204 len: 0 microversion: 2.1 time: 0.581725 Sep 08 14:06:07.786941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 254/501] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:06:07 2022] DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:06:07.796060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.801585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.803883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.804550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.805042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.805833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.806412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.806882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.976508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:07.985655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7a4fefb2-aab3-47ed-b9ef-986f8e5e0dbc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1681 microversion: 2.1 time: 0.193608 Sep 08 14:06:07.986434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 248/502] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:07 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.180035 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:08.180721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:08.188416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.188909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.189357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.190078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.190545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.190973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.209579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:08.351529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:08.360809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4e97ab63-c073-42df-ace6-fa8862a740b0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.185288 Sep 08 14:06:08.361400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 255/503] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:08 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.787632 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:08.794070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:08.795219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.795720 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.796188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.796926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.797393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.797830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.955911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:08.965215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c2a83ea9-e951-458d-b7bf-7513551d6b23 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.181749 Sep 08 14:06:08.965816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 249/504] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:08 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:09.011240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.011842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.019041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.019534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.019975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.020722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.021187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.021617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.165099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.173828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ae36539a-77fc-45eb-939e-17cc89dccecd tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1681 microversion: 2.1 time: 0.166581 Sep 08 14:06:09.174436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 256/505] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:09.384834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.385414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.392173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.392653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.393088 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.393782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.394234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.394653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.413908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.542603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.551418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-67fadf8b-0aac-4da4-a0fd-6a97fcf53d2a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.170964 Sep 08 14:06:09.552159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 250/506] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:09.989869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.990887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.997805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.998287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.998719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.999529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.999981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.000430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.158383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:10.170479 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f8b9fcdf-863f-4fbf-8c6c-f83d2674ef74 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.184757 Sep 08 14:06:10.171072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 257/507] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:10.200710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:10.202126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:10.208313 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.208797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.209238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.209937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.210387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.210901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.285548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7a162ec-e104-4c44-aed5-cc28a541fb87"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:10.288737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:10.296171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.296673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.297289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.298022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.298474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.298932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.382262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:10.397304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b5620c34-f636-4b4c-8fb4-37e98b03e0a7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1681 microversion: 2.1 time: 0.200305 Sep 08 14:06:10.398396 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 251/508] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:10 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:10.578300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:10.578815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:10.585598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.586086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.586532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.587234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:10.587692 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:10.588115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:10.783883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:10.793911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2786dc38-4b12-48b7-a5df-6de37927cd84 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.220253 Sep 08 14:06:10.796829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 252/509] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:10 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:11.194347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.194880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.202135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.202630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.203075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.203795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.204288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.204775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.358175 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-10c8369f-1b78-488e-acb7-a8961149d1b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.076311 Sep 08 14:06:11.360229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 258/510] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:06:10 2022] POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:11.388039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:11.408372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff597ca-3f06-47d9-92c0-b3fc4522c030", "name": "network-vif-deleted", "tag": "60d1c9d8-da7e-445b-9122-c37ad4ef2e1a"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:11.408827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0236fc6d-a39f-4707-8a6d-b64d3eac5eb0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.208473 Sep 08 14:06:11.408827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 253/511] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:11.421072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.421957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.422620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.439509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.444875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.446202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] Creating event network-vif-deleted:60d1c9d8-da7e-445b-9122-c37ad4ef2e1a for instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 on hv-cinder-85646 Sep 08 14:06:11.451483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.452266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.452699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-e50737e0-12e4-49f4-b821-1a6fa5210ff9 req-99c4dae2-3f5e-4aa0-af3f-d25a131f7e5b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090609 Sep 08 14:06:11.453358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.453625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 259/512] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:11.454597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.455198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.455658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.534768 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:11.544071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fce3b3c4-63af-40ba-996e-672ceff66d20 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1613 microversion: 2.1 time: 0.119567 Sep 08 14:06:11.544829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 254/513] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1613 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:11.836578 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.841199 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.848442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.849148 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.849785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.850740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.851402 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.851999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.037029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:12.047489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bf2df1fa-bd59-4614-89ef-a380757f2d18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.215812 Sep 08 14:06:12.048468 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 260/514] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:12.436308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:12.437396 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:12.445111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.446001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.446561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.447391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.447957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.448529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.575176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:12.576974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:12.586914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.588253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.589036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.591333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.591843 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.592357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.629391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:12.629889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:12.630334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:12.630788 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'fault' on Instance uuid 8ff597ca-3f06-47d9-92c0-b3fc4522c030 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:12.705855 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:12.712870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:12.716485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-48f60f11-026b-4400-b125-d3bf752d8e3c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 200 len: 1331 microversion: 2.1 time: 0.144465 Sep 08 14:06:12.716485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 261/515] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:12 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:12.722280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f740d47c-f2ef-41d9-a81a-a7b0a53350e1 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.293108 Sep 08 14:06:12.722881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 255/516] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:12 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:13.071829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:13.072489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:13.079551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.080050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.080548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.081273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.081741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.082213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.233400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:13.241557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-065d79a2-9fa7-451a-b989-b74460ccb1f3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.174022 Sep 08 14:06:13.242376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 262/517] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:13 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:13.739519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:13.740136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:13.746837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:13.747446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:13.747666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.748043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.748519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.749286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.749749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.750183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.753705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.754210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.754623 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.755323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:13.755776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:13.756225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:13.765281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 HTTP/1.1 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:06:13.767577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:06:13.769009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '8ff597ca-3f06-47d9-92c0-b3fc4522c030'} Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:13.769742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:06:13.770921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:13.772009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:13.772009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-283796c9-0bd3-422d-91d3-6557e6dee101 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 404 len: 111 microversion: 2.1 time: 0.033484 Sep 08 14:06:13.772009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 256/518] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:13 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:13.778569 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-affa191b-99c6-4602-8a1f-4bffc303121f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '.version_select at 0x7f7f8affef70>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:13.854431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-affa191b-99c6-4602-8a1f-4bffc303121f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664246500" status: 202 len: 0 microversion: 2.1 time: 0.080023 Sep 08 14:06:13.855205 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 257/519] 10.222.0.97 () {58 vars in 1218 bytes} [Thu Sep 8 14:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664246500 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:06:13.911279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:13.919684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8e685683-fcd8-43b5-8313-5f2ad56a02f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.177263 Sep 08 14:06:13.920293 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 263/520] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:13 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:14.265252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:14.265821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:14.273532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.274025 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.274489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:14.275199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.275659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.276086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:14.421499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:14.430896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-146bee01-de33-49be-8485-27f645b8c7a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.169417 Sep 08 14:06:14.431978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 258/521] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:14 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:14.637929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b308bb08-22ba-4267-b511-b3eb1277dd5f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: .version_select at 0x7f7f8b13daf0>, body: {"keypair": {"name": "tempest-keypair-853590143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bwvlIC7LMnM+SsGgvx+8t1uOPW8wU/rCpW2T6qlizhqXuD8l/x7Teqa41K72TN48qpbSCjMOeZXwP1+OMVY0s+pChMXzAXgi+L+ySsQB49DJBiZW4S14TQk5An8FMLw=="}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:14.654668 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-b308bb08-22ba-4267-b511-b3eb1277dd5f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:06:14.658760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-b308bb08-22ba-4267-b511-b3eb1277dd5f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:06:14.735208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b308bb08-22ba-4267-b511-b3eb1277dd5f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101085 Sep 08 14:06:14.735853 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 264/522] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:06:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:14.951831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:14.952586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:14.960003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.960650 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.961099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:14.961811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:14.962273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:14.962706 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:15.114508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:15.123426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-65e56132-35e4-499e-82a5-e9451d852ebe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.176656 Sep 08 14:06:15.124023 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 259/523] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:14 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:15.455872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:15.456495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:15.463177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:15.463678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:15.464113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:15.464941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:15.465340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:15.465769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:15.610792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:15.619243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f2e77f5b-831b-43b0-a781-77cbc6a27159 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.167295 Sep 08 14:06:15.619826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 265/524] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:15 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:16.148395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:16.149160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:16.156202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:16.156682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:16.157114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:16.157816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:16.158266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:16.158688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:16.337830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:16.346622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7b39421c-383f-46e1-943a-42fd9ed391ba tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.202213 Sep 08 14:06:16.347225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 260/525] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:16 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:16.644466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:16.645285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:16.653111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:16.653616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:16.654061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:16.654882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:16.655363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:16.655907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:16.828905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:16.837274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b3c091e5-aca2-4bd3-b34e-75b0c2197d25 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.196757 Sep 08 14:06:16.844947 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 266/526] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:16 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:17.370649 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:17.371434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:17.378391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:17.378884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:17.379387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:17.380055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:17.380548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:17.380986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:17.544827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:17.546746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-890920912", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ef396a-7d6a-46fb-a5b2-7b67636f85e3"}], "security_groups": [{"name": "tempest-securitygroup--973119477"}], "key_name": "tempest-keypair-853590143", "user_data": "}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:17.553866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1da959c9-f5ea-4908-b738-a3b02b0a2d5c tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.187107 Sep 08 14:06:17.558874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 261/527] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:17 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:17.660649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] validate_networks() for [('21ef396a-7d6a-46fb-a5b2-7b67636f85e3', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:06:17.862536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:17.863203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:17.877229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:17.878049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:17.878490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:17.879304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:17.879759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:17.880201 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:18.104132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:18.112881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-48e05eaf-e0a6-4a16-bef3-00fe4554f04c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1678 microversion: 2.1 time: 0.254283 Sep 08 14:06:18.113783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 262/528] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:17 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:18.146513 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:06:18.146940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:06:18.147413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:06:18.147948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:06:18.148398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:06:18.157981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:18.158516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:18.158973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:18.159814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:18.160296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:18.160730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:18.179716 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:06:18.186607 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:06:18.199908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:06:18.202407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:06:18.365464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a6361e06-ec89-48d9-8042-53cff39ff32a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.822939 Sep 08 14:06:18.366047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 267/529] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:06:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:06:18.377408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fb8fb3e4-ac87-46de-80d7-d4666f4aca4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:18.378033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fb8fb3e4-ac87-46de-80d7-d4666f4aca4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:18.434078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fb8fb3e4-ac87-46de-80d7-d4666f4aca4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:18.441373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fb8fb3e4-ac87-46de-80d7-d4666f4aca4d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1240 microversion: 2.1 time: 0.067811 Sep 08 14:06:18.451773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 263/530] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:18 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:18.581923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:18.582611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:18.590362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:18.590860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:18.591302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:18.592010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:18.592529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:18.592945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:18.759391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:18.771356 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-07356831-c312-4618-b3db-4b2fdc0692c0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.193096 Sep 08 14:06:18.772310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 268/531] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:18 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:19.137562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:19.138173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:19.144358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.144842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.145272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.145960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.146419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.146839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.283183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:19.291183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-08682421-e061-4b16-8379-c9d74f882e18 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1655 microversion: 2.1 time: 0.157392 Sep 08 14:06:19.291734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 264/532] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:19 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:19.314918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:19.321793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.322287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.322859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.346495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Going to try to start instance {{(pid=128400) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 14:06:19.464994 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:19.465746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:19.472219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.472704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.473144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.473842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.474294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.474721 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.542896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:19.550753 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-268168a9-cb0b-4a6b-8f97-7a648b5a50ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1244 microversion: 2.1 time: 0.090273 Sep 08 14:06:19.557395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 265/533] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:19 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:19.571790 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b902fc04-2865-4463-beda-b4dbf4d90881 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action" status: 202 len: 0 microversion: 2.1 time: 0.261011 Sep 08 14:06:19.574749 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 269/534] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:19 2022] POST /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:19.582281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:19.583131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:19.590135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.590621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.591063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.598017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.598017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.598017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.722395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:19.729976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b96ddb48-cae4-4a52-aa03-30cfc18fb2b1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1664 microversion: 2.1 time: 0.151386 Sep 08 14:06:19.733833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 266/535] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:19 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:19.795681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:19.796413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:19.803295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.803787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.804298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.805052 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:19.805516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:19.805956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:19.965530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:19.981630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bea0e713-6f66-481c-b4ea-2a02d8eb0b93 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.190259 Sep 08 14:06:19.982228 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 270/536] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:19 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:20.091860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:20.094273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:20.100270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.100756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.101196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.101880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.102333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.102749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.127745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'flavor' on Instance uuid 116c89d7-a5be-494e-ada1-017ace7fb9e5 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:20.505446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:20.567026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-676ff740-7333-4580-9b49-10928e4a713f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/action" status: 200 len: 32 microversion: 2.1 time: 0.479073 Sep 08 14:06:20.568099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 267/537] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:20 2022] POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:06:20.573878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:20.575161 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:20.579190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:20.579915 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:20.581457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.582196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.582837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.583540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.583997 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.584480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.587755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.588338 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.588780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.589687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.590139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.590836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.675991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:20.678410 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:20.685036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0ce26481-df5d-4cb8-a767-4fc81aed380f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1292 microversion: 2.1 time: 0.115421 Sep 08 14:06:20.685612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 271/538] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:20 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:20.745576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:20.754407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-67e70e32-ef77-4504-8021-e3dc93777676 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.180300 Sep 08 14:06:20.754750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:20.756266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 268/539] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:20 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:20.756422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:20.762514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.763213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.763650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.764375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:20.764833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:20.765416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:20.899348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:20.907186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d3480b63-0486-4d30-9ef4-c8289ed19eba tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1664 microversion: 2.1 time: 0.157131 Sep 08 14:06:20.907760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 272/540] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:20 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:21.006585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:21.007270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:21.014532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.015018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.015447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.016223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.016623 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.021184 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.171952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:21.180290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-50f24055-4b76-4f7b-bdf7-825c3bbe6e40 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.177697 Sep 08 14:06:21.180867 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 269/541] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:21 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:21.709413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:21.710476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:21.716661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.717152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.717592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.718295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.718856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.719185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.778516 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:21.779141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:21.784985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:21.785894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.786377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.786814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.787517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.788005 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.788452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.793808 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f6fd7843-05d5-4795-a0e4-25c201b77cfb tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1300 microversion: 2.1 time: 0.087315 Sep 08 14:06:21.793994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 273/542] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:21 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:21.932388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:21.932934 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:21.933960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:21.939342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.939834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.940361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.941065 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:21.941518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:21.941937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:21.943508 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-71b74750-bb15-4603-945a-6f4b0c800b11 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.168886 Sep 08 14:06:21.956169 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 270/543] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:21 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:22.107532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:22.117156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cae4724a-3753-4ce5-b798-15431aa49cc9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1664 microversion: 2.1 time: 0.188658 Sep 08 14:06:22.119530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 274/544] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:21 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:22.206139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:22.206852 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:22.217155 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.217735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.218402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.219118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.219573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.220114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.391622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:22.400310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2b1141a2-d7b8-4f27-8844-bd42b89a2b5e tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.198237 Sep 08 14:06:22.412776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 271/545] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:22 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:22.817865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:22.818608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:22.825173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.825745 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.826195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.826902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.827368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.827893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.893469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:22.901209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a201967f-efb2-4ec3-8f85-f411413ebbda tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1298 microversion: 2.1 time: 0.087415 Sep 08 14:06:22.901776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 275/546] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:22 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:22.971344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:22.971956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:22.981766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.982429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.983023 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:22.983835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:22.984570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:22.985262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.131279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:23.141431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e211775a-0256-483b-9431-63b8bd5ab910 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.173977 Sep 08 14:06:23.142263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:23.156813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:23.156813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.156813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.156813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.161769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 272/547] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:22 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:23.161865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.161865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.161865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.305783 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:23.314771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e9cfe4cc-9829-43dc-a032-0a425d480fc5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1668 microversion: 2.1 time: 0.176840 Sep 08 14:06:23.315495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 276/548] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:23 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:23.424475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:23.425480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:23.432606 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.433232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.433917 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.434731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.435304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.435834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.604103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:23.613413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ac5c1700-f441-4010-83d8-56f44fbc67e0 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.193011 Sep 08 14:06:23.614006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 273/549] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:23 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:23.928864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:23.929480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:23.932730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:23.937556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.938358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.938963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:23.939679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:23.940372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:23.947572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.077327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:24.086351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4429c387-011a-4c17-ab22-a60618e03a5e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.161427 Sep 08 14:06:24.086985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 277/550] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:23 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:24.095762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c94983-e106-4369-9254-a41da0e031fb", "tag": "45ad8e9a-79a2-43c1-9311-58e8766673dc"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:24.106734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.107310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.107875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.119793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] Creating event network-changed:45ad8e9a-79a2-43c1-9311-58e8766673dc for instance 30c94983-e106-4369-9254-a41da0e031fb on hv-cinder-85646 Sep 08 14:06:24.125420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-bd40a470-8728-44b5-b07f-4b756077a113 req-65f47d13-62cf-4948-be3c-531693a0e6dc service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033803 Sep 08 14:06:24.126138 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 274/551] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:24.167340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.168611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.175411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.175884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.176377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.177114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.177578 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.178011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.313889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:24.325764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c5d1c616-200c-42a4-856e-76c6447f8373 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.162684 Sep 08 14:06:24.326662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 278/552] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:24 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:24.640421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:24.641160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:24.650524 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.651034 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.651455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.652335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:24.652790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:24.653211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:24.800060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:24.808947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5f8304e9-5ede-43dc-8d05-cc26c9e7dd69 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.173438 Sep 08 14:06:24.809532 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 275/553] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:24 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:25.110924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:25.111598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:25.118043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.118544 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.119068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.120066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.120299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.121604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.285150 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:25.298288 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0fc4ddf7-0646-4e62-beee-3146b392fcf7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.186061 Sep 08 14:06:25.298288 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 279/554] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:25 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:25.350773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:25.351331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:25.358424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.358908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.359359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.360068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.360559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.360986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.492790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:25.500848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-550862a7-5542-4def-9145-694d233753b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.154121 Sep 08 14:06:25.501420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 276/555] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:25 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:25.832355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:25.832976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:25.839060 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.839553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.839991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.840722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:25.841180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:25.841609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:25.985295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:25.993575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b991257f-2eec-4b8c-945c-69572e3d06fd tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.165176 Sep 08 14:06:25.994145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 280/556] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:25 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:26.318067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:26.318697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:26.325158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.325634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.326074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.326784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.327264 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.327674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.466224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.474762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b6b87588-5cec-4ad9-a913-6cc2b0677296 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.160530 Sep 08 14:06:26.475358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 277/557] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:26 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:26.524913 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:26.525518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:26.532083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.532598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.533019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.533706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:26.534157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:26.534576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:26.668457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:26.676816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5ec6d0d8-09a5-405f-852b-a11ed10e144a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.155969 Sep 08 14:06:26.677389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 281/558] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:26 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:27.017404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.018020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.020011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:27.024962 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.025437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.025872 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.026582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.027036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.027463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.181688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.191253 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8abe73d9-df89-49cb-b2d0-a07d8ab1114d tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.177904 Sep 08 14:06:27.191844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 278/559] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:27.501122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.501739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.507753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.508322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.508767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.509465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.509927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.510353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.644558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.652466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7714f620-d459-4491-b80c-cd0a3e3d95a5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.155476 Sep 08 14:06:27.653045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 282/560] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:27.700553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:27.701197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:27.708175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.708669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.709107 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.709811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:27.710272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:27.710697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:27.841400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:27.849500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-20209a3c-5543-4eb7-ab3c-50295d93efc8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.153341 Sep 08 14:06:27.850071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 279/561] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:27 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:28.216038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:28.216583 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:28.218508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:28.219383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=10 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:28.224445 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.224942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.225387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.226097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.226561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.226993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.392801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.405655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8b3f13af-1981-466c-b56c-163e940d8ef6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1755 microversion: 2.1 time: 0.194036 Sep 08 14:06:28.406265 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 283/562] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:28 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:28.676057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:28.676726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:28.678586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:28.683318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.688296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.688296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.688296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.688296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.688618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.823132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:28.831483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-149ebde0-7a54-4648-933e-adedf87d05c4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.159268 Sep 08 14:06:28.832134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 280/563] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:28 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:28.874145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:28.874741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:28.881436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.881934 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.882373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:28.883177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:28.883538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:28.883966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.025419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:29.040771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-daea00c6-6eac-4f56-92b9-e46539aa760f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.170602 Sep 08 14:06:29.041893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 284/564] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:28 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:29.431714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.432469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.439334 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.439829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.440321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.441026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.441493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.441919 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.597052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:29.605934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-352536b2-e8ca-4e3f-a027-67646ce8e7dc tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1758 microversion: 2.1 time: 0.178790 Sep 08 14:06:29.606530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 281/565] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:29.855055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:29.855579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:29.861735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.862213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.862638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.863326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:29.863772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:29.864219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:29.999691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.007684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8b7188a0-d822-4ed3-a56a-a65c57e0fb95 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.156463 Sep 08 14:06:30.008362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 285/566] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:29 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:30.065068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:30.065438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:30.072485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.072979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.073454 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.074899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.075368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.090286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.217182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:30.226305 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7dcd2d6d-c774-441e-bb91-08d0898a953f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.165216 Sep 08 14:06:30.226898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 282/567] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:30 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:30.887365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c94983-e106-4369-9254-a41da0e031fb", "name": "network-vif-plugged", "status": "completed", "tag": "45ad8e9a-79a2-43c1-9311-58e8766673dc"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:30.898441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:30.898926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:30.899389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:30.913619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] Creating event network-vif-plugged:45ad8e9a-79a2-43c1-9311-58e8766673dc for instance 30c94983-e106-4369-9254-a41da0e031fb on hv-cinder-85646 Sep 08 14:06:30.919196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b000d865-20f1-4e38-8c41-4e8a13449dbb req-dfb4c86f-217f-4e18-aaa9-6d588dfccb94 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035601 Sep 08 14:06:30.919797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 286/568] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:31.032811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:31.033603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:31.040271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.040798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.041243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.041948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.042447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.042873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.227898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.240782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6b960249-fedb-4e19-9d37-c8ab83412a37 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.213117 Sep 08 14:06:31.241549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 283/569] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:31 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:31.258386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:31.259171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:31.267178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.267699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.268170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.268902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:31.269374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:31.269822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:31.419197 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:31.434227 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-29eb58e7-0b51-4763-9b9f-e0dc8df0fa6b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.185618 Sep 08 14:06:31.434811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 287/570] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:31 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:32.274202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:32.274831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:32.282112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.282644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.283193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.283931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.284481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.285061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.420524 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.429860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-af29244d-692a-42ba-9674-b915d826ce5b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1365 microversion: 2.1 time: 0.159442 Sep 08 14:06:32.430474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 284/571] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:32 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:32.459264 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:32.460592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:32.468346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.468842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.469281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.469987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:32.470450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:32.470886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:32.610742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:32.619296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4523df6a-7e53-42a2-a51e-5eea8a7aacd5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.164166 Sep 08 14:06:32.619929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 288/572] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:32 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:33.454281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:33.454931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.461689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.462181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.462691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.463335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.463797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.464263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.468537 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:33.623092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.631429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bc081e6e-4e85-4a77-9ac3-ec6678523c7d tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1554 microversion: 2.1 time: 0.181358 Sep 08 14:06:33.632031 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 285/573] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:33 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:33.647372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:33.647989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.654992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:33.655355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.664228 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.664476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.664476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.664476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.664476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.665078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.665252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.665416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:33.665622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.665622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.665622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.665622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.666204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.785643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da2f3a47-308c-47a6-9ece-6d70fb7ef1ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134738 Sep 08 14:06:33.786260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 286/574] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:06:33 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:33.848358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:33.859960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d1cb1010-b913-459a-804c-e59de6369d1e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.219115 Sep 08 14:06:33.861088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 289/575] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:33 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:34.869513 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c94983-e106-4369-9254-a41da0e031fb", "tag": "45ad8e9a-79a2-43c1-9311-58e8766673dc"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:34.880641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.881550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.882083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.896464 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] Creating event network-changed:45ad8e9a-79a2-43c1-9311-58e8766673dc for instance 30c94983-e106-4369-9254-a41da0e031fb on hv-cinder-85646 Sep 08 14:06:34.898510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:34.899495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:34.902848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-c0b9b33f-e0bd-437d-b739-fafdef86cd45 req-277ccf78-c4a6-49dc-93b4-d82aefc5d541 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037405 Sep 08 14:06:34.903497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 287/576] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:34.908971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.909890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.910747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:34.911945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:34.912495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:34.913449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:35.079047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:35.087734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c3dbeb2b-1c7f-40b8-842a-451b5dc76549 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.193586 Sep 08 14:06:35.088339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 290/577] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:34 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:36.113019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:36.113618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:36.121049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:36.121546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:36.122000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:36.122741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:36.123206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:36.123632 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:36.281153 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:36.290276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ae1b984e-2c99-4c53-8b43-c172926156ae tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.182589 Sep 08 14:06:36.290846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 288/578] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:36 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:37.313774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:37.314386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:37.321434 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.321925 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.322363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.323069 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:37.324247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:37.324678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:37.455244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:37.463738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a4144ab5-60bd-49ff-93c0-3116a5452a0c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.153804 Sep 08 14:06:37.464358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 291/579] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:37 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:38.489976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:38.490592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:38.498125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.498618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.499050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.499753 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:38.500237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:38.500660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:38.763735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:38.772417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e7b3c739-3cb3-45e8-8848-e198411719c1 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.286280 Sep 08 14:06:38.773000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 289/580] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:38 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:39.799176 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:39.799811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:39.806593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.807074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.807545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:39.808762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:39.809217 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:39.809647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:39.953538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:39.962402 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a1627f41-4af1-4ee8-b5e8-47c958e9a394 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.167073 Sep 08 14:06:39.963164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 292/581] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:39 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:40.989807 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:40.990733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:40.998087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:40.998570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:40.999002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:40.999727 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:41.000198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:41.000622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:41.139962 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:41.149063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3b641685-088d-40b8-9892-1259979f24b8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1733 microversion: 2.1 time: 0.163317 Sep 08 14:06:41.149660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 290/582] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:40 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:42.180671 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.181324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.188674 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.189147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.189578 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.190258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.190711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.191134 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.335908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.345102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a19f6eca-649e-4c06-adfa-97c693cf610b tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1713 microversion: 2.1 time: 0.168641 Sep 08 14:06:42.345713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 293/583] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:42 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:42.462645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.463183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.470130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.470614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.471055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.471746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.472227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.472656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.556834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] HTTP exception thrown: Cannot 'detach_volume' instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 while it is in vm_state rescued Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Request method failure captured: Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments/a7a162ec-e104-4c44-aed5-cc28a541fb87 HTTP/1.1 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXJoEaOlgKFoM9AgkAccLUDTEkz4oDr1gObZObhuPiKiHOchyMYcqKSMKpHM9_zgjn_Jj3-GkQBVSojGJ-gFroxtE7UIMPFlpPZUU_SI68BZdDBeOXqWbTY99O2UNQ0LcJld5Uc9nNvmTZ-7Mb-OjIy3Vyh4H82EUyDKmRtVNSHdiU Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:06:42.559059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_44e7a5fc099c4041aa1a3109962b5dc3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: a30b0734975d4e5a848be44aa7860807 Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:06:42.560422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Cannot 'detach_volume' instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 while it is in vm_state rescued Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'server_id': '116c89d7-a5be-494e-ada1-017ace7fb9e5', 'id': 'a7a162ec-e104-4c44-aed5-cc28a541fb87'} Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:42.561097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 while it is in vm_state rescued Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 while it is in vm_state rescued Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:06:42.562466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Returning 409 to user: Cannot 'detach_volume' instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 while it is in vm_state rescued {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:42.564216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f234b030-3a89-4f32-b980-e61172c68263 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments/a7a162ec-e104-4c44-aed5-cc28a541fb87" status: 409 len: 152 microversion: 2.1 time: 0.101933 Sep 08 14:06:42.564216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 291/584] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:06:42 2022] DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments/a7a162ec-e104-4c44-aed5-cc28a541fb87 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:06:42.569727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:42.570312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.578658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.580164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.580164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.580972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.580972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.581162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.816748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0bb14f8a-0228-467b-ae39-c4ad4ce7b3df tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/action" status: 202 len: 0 microversion: 2.1 time: 0.250751 Sep 08 14:06:42.817656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 294/585] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:42 2022] POST /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:42.829562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:42.830696 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:42.840475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.840970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.841411 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.842121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:42.842582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:42.843018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:42.979972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:42.988728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-93bac8c1-9612-4d1c-b568-6bc4284430f9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1721 microversion: 2.1 time: 0.166070 Sep 08 14:06:42.989400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 292/586] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:42 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:44.014456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:44.015184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:44.022211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.022713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.023157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.023863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.024365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.024796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.209111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:44.218205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cad36c00-17e5-4ac3-b7bd-3e71170049a2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1721 microversion: 2.1 time: 0.207992 Sep 08 14:06:44.218796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 295/587] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:44 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:45.300661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:45.301307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:45.308368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.308870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.309297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.310013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.310475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.310906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.460078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:45.468958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2c0587d4-bac4-432a-9070-3f7b6011b355 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1721 microversion: 2.1 time: 0.231109 Sep 08 14:06:45.469561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 293/588] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:45 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:46.492012 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:46.492683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:46.506208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.506208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.506208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.506648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.507121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.507550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.651036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:46.668678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e8f6e234-08cb-4b55-a815-82074d52962f tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1721 microversion: 2.1 time: 0.180278 Sep 08 14:06:46.669398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 296/589] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:46 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:47.693630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:47.694275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:47.701772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:47.702247 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:47.702677 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:47.703369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:47.703847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:47.704304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.052014 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:48.061492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-10799996-b26d-4dc3-a5d6-86b130110829 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1727 microversion: 2.1 time: 0.371532 Sep 08 14:06:48.062161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 294/590] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:47 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1727 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:48.085564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:48.086281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:48.093342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.093836 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.094274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.095017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.095483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.095924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.183661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ffd4bf7e-86ee-41a9-9f88-b899e0d0f124 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102008 Sep 08 14:06:48.184767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 297/591] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:06:48 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:49.183352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:49.195581 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:49.196690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:49.197399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:49.210951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] Creating event network-changed:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:06:49.217867 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-8c1d4717-8f8f-40aa-b0fb-1682829bf02e req-75fa3f2e-b691-4f9a-947a-f8d94c0b345b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038879 Sep 08 14:06:49.218284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 295/592] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:51.233841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:51.243727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:51.244361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:51.244812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:51.256105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] Creating event network-changed:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:06:51.261111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-cfec83e5-1d93-4012-a6f8-bb1909a5756b req-62b0cd72-dfa7-4619-a48e-16b2aad74bbb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032227 Sep 08 14:06:51.261759 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 298/593] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:02.240516 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:07:02.241081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Thu Sep 8 14:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments (ip 10.222.0.97) !!! Sep 08 14:07:02.242190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=35 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:02.242904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=54 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:02.247634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:02.249952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:02.259870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.260398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.260840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.261546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.262002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.262430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.292917 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-33ba5005-069d-4fc8-a5b4-52bc418c909b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054052 Sep 08 14:07:02.293512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 296/594] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:02 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:07:02.357556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=43 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:02.358323 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:02.362385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:02.362982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:02.369982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.370473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.370912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.371617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.372156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.372594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.397801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:02.681089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-96079ea5-4546-4e48-86a3-d5aafc3fa5c9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 204 len: 0 microversion: 2.1 time: 0.324995 Sep 08 14:07:02.681672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 299/595] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:02 2022] DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:02.697307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:02.698003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:02.704328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.704802 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.705231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.705913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:02.706360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:02.706780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:02.848890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:02.856643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d037b283-6a31-485f-a405-72eebd67f706 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1674 microversion: 2.1 time: 0.163506 Sep 08 14:07:02.857245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 297/596] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:02 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:03.880266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:03.880960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:03.886990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.887465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.887896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:03.888613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:03.889064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:03.889484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:04.018393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:04.026576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5a5b9992-c664-48f8-845f-faee06fc0b4b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1674 microversion: 2.1 time: 0.150749 Sep 08 14:07:04.027132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 300/597] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:03 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:05.051467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:05.052071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:05.058844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.059358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.059792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:05.060523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.060969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.061389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:05.193366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:05.201812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-53c6498e-955e-496c-ba6d-98844ced5029 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1674 microversion: 2.1 time: 0.154256 Sep 08 14:07:05.202377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 298/598] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:05 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:06.225448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:06.226060 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:06.233299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.233831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.234228 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.234929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.235385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.235814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.372555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:06.380885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0cbd2263-c22d-48fa-a128-f32ca066f109 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1674 microversion: 2.1 time: 0.159304 Sep 08 14:07:06.381685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 301/599] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:06 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:06.694933 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fec36d5-04f6-46ec-8406-004966e4e97b", "name": "network-vif-deleted", "tag": "dee806ed-287f-4f49-b833-092647ad43ff"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:06.706609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.707090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.707517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.721436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] Creating event network-vif-deleted:dee806ed-287f-4f49-b833-092647ad43ff for instance 7fec36d5-04f6-46ec-8406-004966e4e97b on hv-cinder-85646 Sep 08 14:07:06.726919 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-11563691-a5f0-4701-b374-6e9a3c0505fa req-a2ce87fb-5299-4ffd-8d51-9786e11e7c8b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 Sep 08 14:07:06.727534 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 299/600] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:07.403686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:07.404628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:07.410964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.411413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.411857 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:07.412655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.413118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.413545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:07.452472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.453233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.453563 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:07.454238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lazy-loading 'fault' on Instance uuid 7fec36d5-04f6-46ec-8406-004966e4e97b {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:07.502505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:07.511129 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7cd3abd2-a844-4107-9f45-4656b55bc9aa tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 200 len: 1327 microversion: 2.1 time: 0.111651 Sep 08 14:07:07.511724 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 302/601] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:07 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:08.536233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:08.536940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:08.543419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:08.543906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:08.544392 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:08.545074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:08.545569 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:08.545993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:08.560765 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b HTTP/1.1 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:07:08.562462 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:07:08.564232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '7fec36d5-04f6-46ec-8406-004966e4e97b'} Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:08.565154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:07:08.566605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:08.568209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:08.568209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-923e4407-8095-4e79-b08c-f26fa332aa59 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 404 len: 111 microversion: 2.1 time: 0.032552 Sep 08 14:07:08.568209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 300/602] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:08 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:08.574373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7930a908-13d6-435d-befe-499cc41520a5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '.version_select at 0x7f7f8af7a670>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:08.653299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7930a908-13d6-435d-befe-499cc41520a5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871236463" status: 202 len: 0 microversion: 2.1 time: 0.084119 Sep 08 14:07:08.653927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 303/603] 10.222.0.97 () {58 vars in 1221 bytes} [Thu Sep 8 14:07:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871236463 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:09.512340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-68dbcab3-dee6-4013-af59-464df8d2684d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: .version_select at 0x7f7f8af9fb80>, body: {"keypair": {"name": "tempest-keypair-1212275921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYeoKJ2bmjHbkNNS3B3JmLHlnqWtlX9XSyu/9W12cz0ZSDEMcEQIFaSGvHQamXm6n6p1PnXNGs72nZr9BzUJxEtlOOs02pSpqlKStRJOOQERo82k8qYZYKTrbdbYCOaCQ=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:09.527837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-68dbcab3-dee6-4013-af59-464df8d2684d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:09.532020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-68dbcab3-dee6-4013-af59-464df8d2684d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for user c18dc6b5898c4e1aae71a028b4840bf0 and project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:09.733651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-68dbcab3-dee6-4013-af59-464df8d2684d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226512 Sep 08 14:07:09.734420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 301/604] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:07:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:12.062639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-47291856"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:12.063390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:12.071266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.072274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.072713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.073523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.073987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.074415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.199601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1366831212", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39e2cb88-2879-4ba3-b085-907a39189f3c"}], "security_groups": [{"name": "tempest-securitygroup--1124926623"}], "key_name": "tempest-keypair-1212275921", "user_data": "}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:12.214504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.network.security_group_api [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Removing security group 118f07d5-0c15-4623-82f6-18df9002a88f from port d42836f7-59df-4047-abf1-f2202598649e Sep 08 14:07:12.375838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] validate_networks() for [('39e2cb88-2879-4ba3-b085-907a39189f3c', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:07:12.842432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1ef7059e-d3c2-4c17-90b9-e1457612d771 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action" status: 202 len: 0 microversion: 2.1 time: 0.784638 Sep 08 14:07:12.843558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 304/605] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:07:12 2022] POST /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:12.853592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:12.864714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.865198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.865621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.878850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] Creating event network-changed:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:07:12.884458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-384eb7d3-1a84-4719-9f24-e95f1f281865 req-b0d47d4a-9e36-4054-93d4-19f0c3a413aa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035431 Sep 08 14:07:12.885545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 305/606] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:13.041216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:07:13.043676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:07:13.043676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:07:13.043676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:07:13.043676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:07:13.056310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.057497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.058153 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.059131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.059887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.060568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.085573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:13.092319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Getting quotas for user c18dc6b5898c4e1aae71a028b4840bf0 and project 73ba0ac1c50e4802b8c055a9b3075022. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:13.106595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:07:13.109115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:07:13.248828 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f36d0732-3476-42b2-a644-d73dcf98528f tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.054807 Sep 08 14:07:13.258530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 302/607] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:07:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:07:13.263542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8b5fa650-19dc-4700-9755-720a7d95d35a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:13.265116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8b5fa650-19dc-4700-9755-720a7d95d35a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:13.388364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8b5fa650-19dc-4700-9755-720a7d95d35a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:13.397236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8b5fa650-19dc-4700-9755-720a7d95d35a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1238 microversion: 2.1 time: 0.139892 Sep 08 14:07:13.397905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 306/608] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:13 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1238 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:14.385742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:14.386603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:14.395110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.395612 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.396063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.396815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.397358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.397799 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.425932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:14.426888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:14.442838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.443408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.443827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.447311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.447797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.448447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.518257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:14.530833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a5693f81-e5ea-4bca-bd5b-6c9119a1838a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1242 microversion: 2.1 time: 0.111695 Sep 08 14:07:14.532111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 307/609] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:14 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:14.545904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lazy-loading 'services' on Instance uuid 97d8087d-ee51-4bac-93f1-9418a39c22d2 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:14.906890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:14.920066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.927295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.927295 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.927539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f4b02c09-1c79-47d1-90d3-79a23edc3ca3 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments/9bfe257c-342a-4fea-ba93-21e1cc119ae5" status: 202 len: 0 microversion: 2.1 time: 0.543030 Sep 08 14:07:14.927539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 303/610] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:07:14 2022] DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments/9bfe257c-342a-4fea-ba93-21e1cc119ae5 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:14.940662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] Creating event network-changed:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:07:14.948205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-125b8960-bdc7-43b6-b41e-d3d364adcf01 req-283364f4-d31f-4e35-ac07-ece486b2b14a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050395 Sep 08 14:07:14.950242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 308/611] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:14.957773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:14.963624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:14.975487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.976455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.981280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.981280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.981280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.981280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.044997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-024e4b77-a974-4fce-9326-18e7dda93095 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105548 Sep 08 14:07:15.050184 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 304/612] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:14 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:15.556989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:15.557730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:15.564102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.564803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.587565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.587565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.587565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.587565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.632658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.639677 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-03081678-9f5d-4ed8-84a3-c87ea3b60f07 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1290 microversion: 2.1 time: 0.088085 Sep 08 14:07:15.640281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 309/613] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:15 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:16.061626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.064135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.072071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.072610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.073055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.073764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.074219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.109328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9ee2e723-60a1-43bb-a645-cb3146fe2957 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051644 Sep 08 14:07:16.114170 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 305/614] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:16.666791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.668379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.680269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.681119 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.682126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.684252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.684252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.684944 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.765922 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.779905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6445e68d-8445-4d7b-9c35-f0752263724d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1290 microversion: 2.1 time: 0.120132 Sep 08 14:07:16.782354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 310/615] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:17.122921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:17.125208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:17.135763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.136409 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.140428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.140428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.140428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.140428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.182719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-88e0e1ea-3f96-4804-91f0-c66c459612c6 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064419 Sep 08 14:07:17.183316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 306/616] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:17 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:07:17.198213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:17.198213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:17.204748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.205346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.205814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.206561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.207031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.207620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.347379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] HTTP exception thrown: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 is not attached to volume 9bfe257c-342a-4fea-ba93-21e1cc119ae5 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Request method failure captured: Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments/9bfe257c-342a-4fea-ba93-21e1cc119ae5 HTTP/1.1 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfZEOvn8UQ9fxZ20gGqVZuUsveg8xSmEc9mdUqUdEmi0ueTWT8MnWy3d0dz-sMmN8eFXZIKDa_gj96liTSQrkFSXMUF1MtatMeiopiEBaixT_vQbgoo0PO35UjpQTPRNXcWZwE7lBXR1xGQSxyh55VsLA9lbL9MaJDhsxyaoDgBbxBs Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 9aa00aef04784c1ea61221c69e872045 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:07:17.349797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9aa00aef04784c1ea61221c69e872045", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 9aa00aef04784c1ea61221c69e872045 Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-TestMinimumBasicScenario-795771399-project Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 775ee674f5084d01b48d7b3ef20c7864 Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-TestMinimumBasicScenario-795771399-project Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:07:17.352006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 is not attached to volume 9bfe257c-342a-4fea-ba93-21e1cc119ae5 Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'server_id': '97d8087d-ee51-4bac-93f1-9418a39c22d2', 'id': '9bfe257c-342a-4fea-ba93-21e1cc119ae5'} Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9bfe257c-342a-4fea-ba93-21e1cc119ae5. Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:17.353484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 is not attached to volume 9bfe257c-342a-4fea-ba93-21e1cc119ae5 Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 is not attached to volume 9bfe257c-342a-4fea-ba93-21e1cc119ae5 Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:17.354995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Returning 404 to user: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 is not attached to volume 9bfe257c-342a-4fea-ba93-21e1cc119ae5 {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:17.356564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1fb28f3a-06da-4920-8a76-87c731d3d1b4 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments/9bfe257c-342a-4fea-ba93-21e1cc119ae5" status: 404 len: 154 microversion: 2.1 time: 0.161873 Sep 08 14:07:17.356564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 311/617] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:07:17 2022] DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2/os-volume_attachments/9bfe257c-342a-4fea-ba93-21e1cc119ae5 => generated 154 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:17.803068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:17.803607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:17.810796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.810972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.811593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.812538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:17.813002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:17.813437 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:17.972763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:17.982186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-39ac100e-5014-43ed-b7fa-cc7aadc89901 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.183065 Sep 08 14:07:17.986362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 307/618] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:17 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:18.656356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:18.657027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:18.663503 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.663985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.664469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.665866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.666303 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.666726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.679684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:18.680438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:18.687988 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.688555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.689228 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.690439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.691109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.691664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.694862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:18.718243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c1639473-796b-48f6-b442-b5c1ae94764e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/ips" status: 200 len: 149 microversion: 2.1 time: 0.126972 Sep 08 14:07:18.722424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 312/619] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:07:18 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/ips => generated 149 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:18.854672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab21e8a-b3f7-498c-9b87-f504625d8f62", "tag": "e902e854-c899-4f4c-866d-e8871faa861d"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:18.864500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.864974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.865399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.877706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] Creating event network-changed:e902e854-c899-4f4c-866d-e8871faa861d for instance aab21e8a-b3f7-498c-9b87-f504625d8f62 on hv-cinder-85646 Sep 08 14:07:18.884665 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-928b08f6-5197-49b4-b29f-5bc9035b05fe req-86672b88-cbb7-443a-a2b7-32c1949d1c23 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147532 Sep 08 14:07:18.885634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 313/620] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:19.004305 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3510b928-7338-46db-919c-eab1d3bdec7a tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 204 len: 0 microversion: 2.1 time: 0.350575 Sep 08 14:07:19.006303 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 308/621] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:18 2022] DELETE /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:07:19.011648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:19.012983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:19.024274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.025042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:19.025835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.026667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:19.027003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.028309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.029162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.029957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.038545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.039539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.040509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.041906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:19.043056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:19.044181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:19.280654 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.285164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cbf36a38-cb3e-47a1-b2cd-b146963fb041 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1554 microversion: 2.1 time: 0.271261 Sep 08 14:07:19.286183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 309/622] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:19 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:19.288327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:19.302358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-98e591ce-d6f0-45ce-9425-5f75239e6d3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.299640 Sep 08 14:07:19.303440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 314/623] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:19 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:20.327697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:20.328503 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:20.331757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:20.331757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:20.338380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.338875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.339318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.340033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.340197 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.340525 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.340628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.340949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.341050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.341754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.342268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.342706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.765624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.769756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:20.773664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b02486a3-f7ca-4380-94dd-011d7bc74737 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.447401 Sep 08 14:07:20.774314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 315/624] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:20 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:20.777666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-828bb57d-854a-46f9-b5ac-ea1d79c8cdb9 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1554 microversion: 2.1 time: 0.454169 Sep 08 14:07:20.778422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 310/625] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:20 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1554 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:20.779439 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00650dd2-6e30-4e69-912d-472bdcc9229e"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:20.781886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:20.788115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.788647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.789095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:20.789847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:20.790314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:20.790741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.563522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:21.642798 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-64b6a84e-a838-47e8-8411-48dbeeb96c42 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867064 Sep 08 14:07:21.643751 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 316/626] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:07:20 2022] POST /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:21.800186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:21.800847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:21.810276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.814565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:21.814907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.814999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:21.815085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.815085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.815085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.815085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.823268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.823771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.824245 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.825071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.825539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.826038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.894262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:21.903358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e8c26e1b-91ac-4d98-9ced-71ab8e0313fe tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1512 microversion: 2.1 time: 0.107100 Sep 08 14:07:21.904060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 311/627] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:21 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:21.908854 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d8087d-ee51-4bac-93f1-9418a39c22d2", "name": "network-vif-deleted", "tag": "d42836f7-59df-4047-abf1-f2202598649e"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:21.919289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:21.919979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:21.920624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:21.946939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] Creating event network-vif-deleted:d42836f7-59df-4047-abf1-f2202598649e for instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 on hv-cinder-85646 Sep 08 14:07:21.950015 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-3d212953-0661-4ec1-8376-4def4e84f947 req-53958721-f09f-42e2-949c-6251485189d7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044132 Sep 08 14:07:21.951174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 312/628] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:22.006151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:22.015410 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ce7a90ff-433c-4c39-954e-ffced27c4cf9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.209300 Sep 08 14:07:22.016002 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 317/629] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:21 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:22.930540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:22.931347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:22.938142 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.938642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.939080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.939818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.940296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.940728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.976580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:22.977148 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:22.978087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:22.978556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lazy-loading 'fault' on Instance uuid 97d8087d-ee51-4bac-93f1-9418a39c22d2 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:22.985154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:23.035062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775ee674f5084d01b48d7b3ef20c7864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa00aef04784c1ea61221c69e872045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.044869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:23.046039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:23.060127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.060699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.061132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.061855 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:23.062320 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:23.062742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:23.062936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d33b28fa-0ca4-4210-9564-7b0999fafe7b tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 200 len: 1347 microversion: 2.1 time: 0.132903 Sep 08 14:07:23.064435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 313/630] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:22 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 1347 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:23.241122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:23.249221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1c367381-fb3c-468d-8375-f1b8ab0caeb3 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.209210 Sep 08 14:07:23.249815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 318/631] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:23 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:24.089636 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.090175 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] [instance: 97d8087d-ee51-4bac-93f1-9418a39c22d2] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:24.091951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:24.092671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=10 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:24.099244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.099737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.100192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.100924 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.101378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.101800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.117235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] HTTP exception thrown: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Request method failure captured: Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 HTTP/1.1 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfZEOvn8UQ9fxZ20gGqVZuUsveg8xSmEc9mdUqUdEmi0ueTWT8MnWy3d0dz-sMmN8eFXZIKDa_gj96liTSQrkFSXMUF1MtatMeiopiEBaixT_vQbgoo0PO35UjpQTPRNXcWZwE7lBXR1xGQSxyh55VsLA9lbL9MaJDhsxyaoDgBbxBs Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 9aa00aef04784c1ea61221c69e872045 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:07:24.119490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/9aa00aef04784c1ea61221c69e872045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_9aa00aef04784c1ea61221c69e872045", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 9aa00aef04784c1ea61221c69e872045 Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-TestMinimumBasicScenario-795771399 Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-TestMinimumBasicScenario-795771399-project Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 775ee674f5084d01b48d7b3ef20c7864 Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-TestMinimumBasicScenario-795771399-project Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. Sep 08 14:07:24.121125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '97d8087d-ee51-4bac-93f1-9418a39c22d2'} Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:24.122032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. Sep 08 14:07:24.123266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:24.124333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Returning 404 to user: Instance 97d8087d-ee51-4bac-93f1-9418a39c22d2 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:24.124333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bc046619-6b85-4878-930c-8619681812ee tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2" status: 404 len: 111 microversion: 2.1 time: 0.035781 Sep 08 14:07:24.124333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 314/632] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:24 2022] GET /compute/v2.1/servers/97d8087d-ee51-4bac-93f1-9418a39c22d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:07:24.130086 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5d47766c-bd67-4cb7-8550-1442781436f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] Calling method '.version_select at 0x7f7f8ae911f0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.137593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:24.264316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5d47766c-bd67-4cb7-8550-1442781436f5 tempest-TestMinimumBasicScenario-795771399 tempest-TestMinimumBasicScenario-795771399-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-277873648" status: 202 len: 0 microversion: 2.1 time: 0.138057 Sep 08 14:07:24.265004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 319/633] 10.222.0.97 () {58 vars in 1269 bytes} [Thu Sep 8 14:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-277873648 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:24.274421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:24.275046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:24.281256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.281750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.282208 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.282923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:24.283383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:24.284395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:24.438954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:24.453372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4d0eadbe-49b5-4191-a5d0-f4797f2f8ca4 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.183379 Sep 08 14:07:24.454274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 315/634] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:24 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:25.479955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:25.480605 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:25.487455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:25.487940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:25.488407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:25.489127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:25.489584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:25.490010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:25.648357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:25.659077 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9955bfe2-3110-4963-8169-dec265547058 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.184711 Sep 08 14:07:25.660100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 320/635] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:25 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:26.682891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:26.683541 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:26.690611 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.691103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.691528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.692523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:26.692700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:26.693536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:26.923030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:26.938266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0d577817-1cb5-4879-abf8-c46a1ef49c86 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.259104 Sep 08 14:07:26.939661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 316/636] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:26 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:27.347636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab21e8a-b3f7-498c-9b87-f504625d8f62", "name": "network-vif-plugged", "status": "completed", "tag": "e902e854-c899-4f4c-866d-e8871faa861d"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:27.358522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.359021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.359546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.371957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] Creating event network-vif-plugged:e902e854-c899-4f4c-866d-e8871faa861d for instance aab21e8a-b3f7-498c-9b87-f504625d8f62 on hv-cinder-85646 Sep 08 14:07:27.377616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-246cf10a-c91f-48dc-8fa6-757460d5e8e0 req-8fa335a4-971f-437c-86d9-041cd39fcc98 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117376 Sep 08 14:07:27.378361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 321/637] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:27.977476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:27.978952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:27.987351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.987683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.988133 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:27.988928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:27.989407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:27.989847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.105901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.107281 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.115943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.117007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.117738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.118788 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.119475 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.120333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.253573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:28.271946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'services' on Instance uuid 116c89d7-a5be-494e-ada1-017ace7fb9e5 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:28.274575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-33fab2b5-d376-407a-bc01-34db1405ec24 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.301931 Sep 08 14:07:28.276408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 317/638] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:27 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:28.569771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-64f7dbc8-a505-4dbe-b394-50667da380bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments/a7a162ec-e104-4c44-aed5-cc28a541fb87" status: 202 len: 0 microversion: 2.1 time: 0.472173 Sep 08 14:07:28.571784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 322/639] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:07:28 2022] DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments/a7a162ec-e104-4c44-aed5-cc28a541fb87 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:07:28.585267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:28.590358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:28.602215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.602717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.603407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.604701 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:28.605626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:28.606416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:28.647229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4fb4205d-4a5a-4a83-ab4f-ed49733a1d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068736 Sep 08 14:07:28.648166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 318/640] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:28 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:29.304325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.308731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.317788 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.319095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.319095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.319520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.320275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.321190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.555337 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:29.571351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-06f87921-388b-48ed-9634-49bb0116dd4d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1364 microversion: 2.1 time: 0.270064 Sep 08 14:07:29.574756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 323/641] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:29.668670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:29.673921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:29.692944 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.693866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.694647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.696192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:29.697024 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:29.697789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:29.739528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-557819c9-860e-4404-8f56-3250a7d8df17 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081729 Sep 08 14:07:29.740641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 319/642] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:29 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:30.614107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.614825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.622828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.623321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.623948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.624711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.625180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.631080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.755009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.757130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.764196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.764666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.765152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.765845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.766307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.766739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.803757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e84daa80-e784-4e7f-91a2-8d9f1f983221 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054002 Sep 08 14:07:30.804134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 320/643] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:30.871443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:30.880840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-efb110e9-f58b-405b-9471-c763c567e7a7 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1551 microversion: 2.1 time: 0.270722 Sep 08 14:07:30.881559 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 324/644] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1551 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:30.909275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:30.909788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:30.916543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.917046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.917493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:30.918228 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:30.918702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:30.919135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.027187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-706eb440-d1cf-4a2e-87d9-956ed1d33362 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121440 Sep 08 14:07:31.028190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 321/645] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:07:30 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:31.534339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00650dd2-6e30-4e69-912d-472bdcc9229e"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:31.546114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:31.550638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.551799 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.552500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.553530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.554166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.554771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.651536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: POST /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments HTTP/1.1 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 74 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:07:31.653672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {"volumeAttachment": {"volumeId": "00650dd2-6e30-4e69-912d-472bdcc9229e"}} Sep 08 14:07:31.655190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'server_id': '30c94983-e106-4369-9254-a41da0e031fb', 'body': {'volumeAttachment': {'volumeId': '00650dd2-6e30-4e69-912d-472bdcc9229e'}}} Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:31.656088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:31.657514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 400 to user: Invalid volume: volume 00650dd2-6e30-4e69-912d-472bdcc9229e is already attached to instances: 30c94983-e106-4369-9254-a41da0e031fb {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:31.658941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f7acc467-27b0-4c06-b5f4-776b8cca5f9e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128574 Sep 08 14:07:31.659401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 325/646] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:07:31 2022] POST /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:07:31.732666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:31.734198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:31.747974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.748792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.751575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.751575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.751771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.752416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.823158 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:31.825750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:31.833257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.833888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.834390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.835234 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:31.835760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:31.836781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:31.879154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-554db3a6-76f1-416b-a6b9-f8edc0e8427d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060432 Sep 08 14:07:31.885848 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 326/647] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:31 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:31.890693 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'services' on Instance uuid 30c94983-e106-4369-9254-a41da0e031fb {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:32.593516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab21e8a-b3f7-498c-9b87-f504625d8f62", "tag": "e902e854-c899-4f4c-866d-e8871faa861d"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:32.606120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:32.607929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.608443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.608873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.623156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] Creating event network-changed:e902e854-c899-4f4c-866d-e8871faa861d for instance aab21e8a-b3f7-498c-9b87-f504625d8f62 on hv-cinder-85646 Sep 08 14:07:32.629954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b3700c59-51d5-4d76-a8bd-aef27ac859db req-3dd76f7f-fe73-4bda-969b-0862e7af61ae service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040568 Sep 08 14:07:32.635723 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 327/648] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:32.838764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-019740ff-8219-4181-a2ab-73e533b35b64 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments/00650dd2-6e30-4e69-912d-472bdcc9229e" status: 202 len: 0 microversion: 2.1 time: 1.112468 Sep 08 14:07:32.843093 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 322/649] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:07:31 2022] DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments/00650dd2-6e30-4e69-912d-472bdcc9229e => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:07:32.851365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:32.853766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:32.880223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.881456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.883565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.886507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.889626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.895896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.903700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:32.909765 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:32.917238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:32.927902 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.929344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.930704 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:32.932511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:32.934069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:32.935199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.011964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d87a5187-3bcc-4a6f-bb12-f9d7c7b10004 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166225 Sep 08 14:07:33.016897 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 328/650] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:32 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:33.053210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-318decc8-5bf3-4362-be50-2de6a9ea4e7a tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162610 Sep 08 14:07:33.072912 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 323/651] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:32 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:07:33.159707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:33.160580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:33.167417 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.168310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.169008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.170055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.170797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.171473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.216775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:33.687934 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5df58632-a89b-4abc-b2da-c8cf6e8f6845 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 204 len: 0 microversion: 2.1 time: 0.533604 Sep 08 14:07:33.688993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 329/652] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:33 2022] DELETE /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:33.700856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:33.702559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:33.740373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.740883 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.741329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:33.746819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:33.747330 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:33.750328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.030332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:34.034316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:34.046477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.048208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.049087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:34.049869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.050440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:34.051074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:34.051933 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:34.061391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-aa9989ff-254b-49db-ae00-9f2fce9b8654 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1687 microversion: 2.1 time: 0.366581 Sep 08 14:07:34.062008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 324/653] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:33 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1687 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:34.118665 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-eb307ecd-7561-4503-83c8-fb58de62db34 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095466 Sep 08 14:07:34.120044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 330/654] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:34 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:35.093480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:35.094223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:35.102743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.103235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.103673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.104422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.105109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.105538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.141080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:35.150623 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:35.178717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.182240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.185474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.188809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:35.188809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:35.188809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:35.259899 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-70493704-39ac-4cb7-9ed4-00a543c435f2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129361 Sep 08 14:07:35.270008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 331/655] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:35 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:35.372739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:35.401413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-666e4e54-90bb-4076-9ce7-919c94a3a9d7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1687 microversion: 2.1 time: 0.312055 Sep 08 14:07:35.404718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 325/656] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:35 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1687 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:36.273986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:36.276250 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:36.283469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.283960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.284429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.285136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.285592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.286016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.320665 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-de694549-e6b8-498b-be34-f2f762312f10 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051159 Sep 08 14:07:36.327235 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 332/657] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:36 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:36.425228 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:36.425981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:36.437621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.438496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.439341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.440693 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:36.441528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:36.442294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:36.654367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:36.668819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ef789f9f-e4b0-4e7b-859a-46b966b126a8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1687 microversion: 2.1 time: 0.247144 Sep 08 14:07:36.669904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 326/658] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:36 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1687 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:37.337356 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:37.339815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:37.348123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.348672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.349115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:37.349902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.350478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.350923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:37.375145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:37.399853 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-582e3011-91b5-437c-9721-3cc2734e982f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067455 Sep 08 14:07:37.400714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 333/659] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:37 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:37.695553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:37.697071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:37.704955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.705646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.706279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:37.707530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:37.708083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:37.708644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:37.969331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:37.980195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c1007bdf-d3bd-4d09-839f-a3a651b80f28 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1687 microversion: 2.1 time: 0.290079 Sep 08 14:07:37.981639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 327/660] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:37 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:38.417076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:38.419372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:38.433097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.433605 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.434113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.434773 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.435710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.435710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.471049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-44f10471-720a-4bea-b8ca-3617c917f8ae tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058568 Sep 08 14:07:38.475903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 334/661] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:07:38 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:07:38.545167 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:38.545688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:38.552068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.552603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.553036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.553768 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.554226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.554777 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.583825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:38.838628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:38.871992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116c89d7-a5be-494e-ada1-017ace7fb9e5", "name": "network-vif-deleted", "tag": "a12131e2-c639-4cbe-9af6-2de2434ee285"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:38.884441 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:38.884926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:38.885354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:38.899761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] Creating event network-vif-deleted:a12131e2-c639-4cbe-9af6-2de2434ee285 for instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 on hv-cinder-85646 Sep 08 14:07:38.912846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b83cd0ca-2342-4403-9c0e-7988590517a7 req-e162c36a-9000-4ddc-b348-f3bc5ee6f507 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037358 Sep 08 14:07:38.912846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 335/662] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:39.021841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.022633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.035945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.036720 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.037424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.038544 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.039290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.039937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.115892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:39.125552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1188c204-499d-47ab-b364-49a817aa27fb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1620 microversion: 2.1 time: 0.108394 Sep 08 14:07:39.126141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 336/663] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:39 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1620 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:39.170970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b0072bee-3c2f-4745-aabb-423c71ea29a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 204 len: 0 microversion: 2.1 time: 0.629431 Sep 08 14:07:39.171687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 328/664] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:38 2022] DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:07:39.181146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:39.181878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.189461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.190094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.190754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.191519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.192040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.192565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.358106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:39.366367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5bbe1476-0575-43cf-8fbf-32fc1f442203 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1679 microversion: 2.1 time: 0.190051 Sep 08 14:07:39.367713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 337/665] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:39 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:39.792879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:39.793907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:39.802746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.803584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.804366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.805119 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:39.805589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:39.806020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:39.835621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lazy-loading 'flavor' on Instance uuid 7c297e02-238c-4210-9932-aece5d5a3529 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:40.152523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:40.167416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:40.167416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.167416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.167416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.167886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.167886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.167886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.201532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.201934 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.202456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.202978 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'fault' on Instance uuid 116c89d7-a5be-494e-ada1-017ace7fb9e5 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:40.246987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:40.256108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-34d99179-caf2-4605-a553-a594f5a1ad4d tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1336 microversion: 2.1 time: 0.108069 Sep 08 14:07:40.256450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 338/666] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:40 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:40.391160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:40.391762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:40.399183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.400043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.400833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.402069 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.402905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.403841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.561576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:40.571548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ba85e3bc-5ced-4cb6-a18f-314ac7902ac7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1679 microversion: 2.1 time: 0.184181 Sep 08 14:07:40.572188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 339/667] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:40 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:40.633946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-29dd7928-044d-4134-8a8d-afda7e5117a0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "POST /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529/action" status: 202 len: 0 microversion: 2.1 time: 0.845552 Sep 08 14:07:40.634909 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 329/668] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:07:39 2022] POST /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:40.643883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:40.644542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:40.651342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.651836 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.652418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.653179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:40.653643 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:40.654081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:40.819308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:40.829443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3015f192-9b24-4625-b6d2-5c99a4add58a tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.190020 Sep 08 14:07:40.830035 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 340/669] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:40 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:41.281134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.281754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.288440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.288957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.289400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.290095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.290550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.290977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.326795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.327287 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.327878 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.328377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'fault' on Instance uuid 116c89d7-a5be-494e-ada1-017ace7fb9e5 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:41.370681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:41.378662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0cb56093-ea9f-479b-91b6-126539471fb5 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1336 microversion: 2.1 time: 0.101831 Sep 08 14:07:41.379271 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 330/670] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:41 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:41.597963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.603544 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.605835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.606331 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.606770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.607488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.607944 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.608408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.747642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:41.756356 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7c0186d3-f2c7-4634-ba79-7ed20c4a2ccf tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1679 microversion: 2.1 time: 0.162158 Sep 08 14:07:41.757938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 341/671] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:41 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:41.853947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:41.854605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:41.861356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.861816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.862252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:41.862951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:41.863545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:41.863812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.022845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:42.031383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bfe27b0f-97b6-4f87-9878-02e5fdece99b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.181468 Sep 08 14:07:42.031969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 331/672] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:41 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:42.402501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:42.403589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:42.414826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.415698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.416351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.417419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.418124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.418603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.453981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.454474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.454920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.455405 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'fault' on Instance uuid 116c89d7-a5be-494e-ada1-017ace7fb9e5 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:42.502111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:42.512013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dc626713-ee16-49c9-a3d3-6063aac3b92c tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 200 len: 1336 microversion: 2.1 time: 0.113689 Sep 08 14:07:42.520320 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 342/673] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:42 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:42.564350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c94983-e106-4369-9254-a41da0e031fb", "name": "network-vif-deleted", "tag": "45ad8e9a-79a2-43c1-9311-58e8766673dc"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:42.576194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.577511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.577511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.591206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] Creating event network-vif-deleted:45ad8e9a-79a2-43c1-9311-58e8766673dc for instance 30c94983-e106-4369-9254-a41da0e031fb on hv-cinder-85646 Sep 08 14:07:42.597179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-fb0756b9-9c54-4dd1-aff8-ffcd7bfce0db req-f252314e-9c54-4fb3-9de2-836fd552adff service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036239 Sep 08 14:07:42.597964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 332/674] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:42.784107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:42.785383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:42.794595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.795258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.795748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.796689 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:42.797191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:42.797659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:42.891739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:42.904914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-896e7709-c579-44e2-86bb-c40cfe0adc2a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1612 microversion: 2.1 time: 0.124813 Sep 08 14:07:42.905935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 343/675] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:42 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1612 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:43.064084 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:43.064929 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:43.072610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.073471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.074086 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.075099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.075773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.076477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.294335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:43.303778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9ecf5787-f63d-432a-ac96-394c0575f073 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.244562 Sep 08 14:07:43.313225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 333/676] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:43 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:43.537587 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:43.538258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 116c89d7-a5be-494e-ada1-017ace7fb9e5] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:43.544764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.545292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.548846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.548846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.548846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.548846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.563852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] HTTP exception thrown: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Request method failure captured: Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 HTTP/1.1 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXJoEaOlgKFoM9AgkAccLUDTEkz4oDr1gObZObhuPiKiHOchyMYcqKSMKpHM9_zgjn_Jj3-GkQBVSojGJ-gFroxtE7UIMPFlpPZUU_SI68BZdDBeOXqWbTY99O2UNQ0LcJld5Uc9nNvmTZ-7Mb-OjIy3Vyh4H82EUyDKmRtVNSHdiU Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:07:43.565619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_44e7a5fc099c4041aa1a3109962b5dc3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: a30b0734975d4e5a848be44aa7860807 Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. Sep 08 14:07:43.567183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '116c89d7-a5be-494e-ada1-017ace7fb9e5'} Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:43.567998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. Sep 08 14:07:43.570592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:43.572050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Returning 404 to user: Instance 116c89d7-a5be-494e-ada1-017ace7fb9e5 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:43.572050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2f755f4a-e6d3-4a19-9ac1-32cc72221d38 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5" status: 404 len: 111 microversion: 2.1 time: 0.033458 Sep 08 14:07:43.572050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 344/677] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:43 2022] GET /compute/v2.1/servers/116c89d7-a5be-494e-ada1-017ace7fb9e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:43.584278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-895a94d7-01d5-4b39-a4d1-96712b2d2582 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '.version_select at 0x7f7f8aef94c0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:43.714698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-895a94d7-01d5-4b39-a4d1-96712b2d2582 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141537914" status: 202 len: 0 microversion: 2.1 time: 0.138422 Sep 08 14:07:43.715372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 334/678] 10.222.0.97 () {58 vars in 1221 bytes} [Thu Sep 8 14:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141537914 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:43.935273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:43.936769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:43.947534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.948064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.948535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.949258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.949722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.950166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.986928 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.987411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.987847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.988340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'fault' on Instance uuid 30c94983-e106-4369-9254-a41da0e031fb {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:44.031512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:44.046242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b7142796-e92d-434a-a1b7-b9140c948d91 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 200 len: 1330 microversion: 2.1 time: 0.111514 Sep 08 14:07:44.046242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 345/679] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:43 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:44.334990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:44.335599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:44.341777 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:44.342509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:44.342945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:44.343643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:44.344098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:44.344628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:44.506388 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:44.514847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-90f269af-aabd-4ac9-b8dd-62cb3a17bc15 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.184464 Sep 08 14:07:44.515439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 335/680] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:44 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:45.066244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:45.066895 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:45.074248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.074741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.075182 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.075927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.076406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.076914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.091707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb HTTP/1.1 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:07:45.093315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:07:45.104284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '30c94983-e106-4369-9254-a41da0e031fb'} Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:45.105114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:07:45.106291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:07:45.107354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:45.107354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b3e02204-dc27-4ea0-aa1a-c18b7d7bd59f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 404 len: 111 microversion: 2.1 time: 0.032562 Sep 08 14:07:45.107354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 346/681] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:45 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:07:45.107570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9461b1d3-908b-47cf-810d-38a4da050461 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '.version_select at 0x7f7f8b117c10>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:45.200227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9461b1d3-908b-47cf-810d-38a4da050461 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853590143" status: 202 len: 0 microversion: 2.1 time: 0.099916 Sep 08 14:07:45.200795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 336/682] 10.222.0.97 () {58 vars in 1218 bytes} [Thu Sep 8 14:07:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853590143 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:45.538839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:45.540269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:45.545776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.546271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.546711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.547413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:45.547878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:45.548343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:45.784612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:45.793040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dfb89821-d8fd-4645-a3b5-fb782bede15f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.258034 Sep 08 14:07:45.793659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 347/683] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:45 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:46.157078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-19ab0d0f-8e4e-4c07-ad4e-01c31d268d12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: .version_select at 0x7f7f8afefa60>, body: {"keypair": {"name": "tempest-keypair-1188053547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR5L1hQCSsR6KtZQbrz/txI5bYp1xCdCXg0K0tDl1TUhK7twiguUEyw2/Heg4jEs/rubo7g2wUPmEugzKsC0Ew+IdsKtjzXLmDWnj4SvldvRtJ6/rCWsNuFNWbbVf5Quw=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:46.175520 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-19ab0d0f-8e4e-4c07-ad4e-01c31d268d12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:46.179979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-19ab0d0f-8e4e-4c07-ad4e-01c31d268d12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:46.302785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-19ab0d0f-8e4e-4c07-ad4e-01c31d268d12 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151708 Sep 08 14:07:46.303233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 337/684] 10.222.0.97 () {60 vars in 1159 bytes} [Thu Sep 8 14:07:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:46.816796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:46.817409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:46.824419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:46.824908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:46.825344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:46.826347 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:46.826598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:46.826996 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:46.998359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:47.007518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-100cd2f0-137e-4d42-8759-8fcb58430972 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.194291 Sep 08 14:07:47.008165 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 348/685] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:46 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:47.348588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:47.349125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:47.356436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.356931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.357372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:47.358082 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.358545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.358977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:47.385668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:47.770860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-871ff885-db6c-4edd-8cce-b46ad393b427 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 204 len: 0 microversion: 2.1 time: 0.425775 Sep 08 14:07:47.771577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 338/686] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:47 2022] DELETE /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:47.780298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:47.780941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:47.797155 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.797656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.798099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:47.798812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:47.799274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:47.799711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:48.032938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:48.033316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:48.034036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:48.040336 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:48.040834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:48.041289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:48.042045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:48.042244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aa387c5f-e8af-4b4f-94de-ec9ccdbdabd0 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1508 microversion: 2.1 time: 0.265642 Sep 08 14:07:48.042490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:48.042619 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 349/687] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:47 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:48.043643 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:48.493903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:48.502590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2be596c4-01fc-4c0a-9bfb-656c8932ea1e tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.475074 Sep 08 14:07:48.503191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 339/688] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:48 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:49.066672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:49.067291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:49.074824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.075317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.075762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:49.076529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.076999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.077430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:49.295205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:49.302981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4c2948ba-7eef-4276-b5f0-139fd303e060 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1508 microversion: 2.1 time: 0.240414 Sep 08 14:07:49.303633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 350/689] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:49 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:49.478362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701163433", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ef396a-7d6a-46fb-a5b2-7b67636f85e3"}], "security_groups": [{"name": "tempest-securitygroup--334450458"}], "key_name": "tempest-keypair-1188053547", "user_data": "}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:49.528998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:49.529652 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:49.539438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.539938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.540504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:49.541103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:49.541546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:49.541974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:49.547776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:49.645988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] validate_networks() for [('21ef396a-7d6a-46fb-a5b2-7b67636f85e3', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:07:49.794851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:49.802823 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5b5ff6d8-cf83-4802-a71d-fbac65595021 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.279794 Sep 08 14:07:49.803655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 351/690] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:49 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:50.088931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:07:50.089417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:07:50.089892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:07:50.090306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:07:50.094039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:07:50.101565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.102048 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.102477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.103193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.103642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.104118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.121113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:50.125223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Getting quotas for user 9b0569d9de724d5fbe3f41cbc0687d75 and project 92a3e908b87b445b9674d48f9a61bf94. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:50.136192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:07:50.138500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:07:50.256077 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20dfb69d-2dd9-4803-9a84-af1dd315f6c1", "name": "network-vif-deleted", "tag": "706e4ad8-bdad-41ff-9794-bc52eb9cf0ff"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:50.266162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.266642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.268605 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.280128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] Creating event network-vif-deleted:706e4ad8-bdad-41ff-9794-bc52eb9cf0ff for instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 on hv-cinder-85646 Sep 08 14:07:50.285753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b49db46c-6b31-4c27-9f4d-9e1cd272ab3d req-8c318dfa-e665-47c7-bbde-d5a40932be05 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Sep 08 14:07:50.286510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 352/691] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:50.308320 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3a21b324-1823-4520-9922-964a2a09bd02 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.834389 Sep 08 14:07:50.309180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 340/692] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:07:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:07:50.331235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:50.332554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:50.335522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b866f9c7-0bb6-4565-bd6d-b28a30e8e8f4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:50.336311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b866f9c7-0bb6-4565-bd6d-b28a30e8e8f4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:50.359797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.360779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.361463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.363033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.363754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.364450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.424492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b866f9c7-0bb6-4565-bd6d-b28a30e8e8f4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:50.433589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b866f9c7-0bb6-4565-bd6d-b28a30e8e8f4 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1241 microversion: 2.1 time: 0.108135 Sep 08 14:07:50.434322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 353/693] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:50 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:50.458390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:50.466490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-49ae1b5f-9b8d-425b-bfa0-53c3fb575ea7 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1466 microversion: 2.1 time: 0.141541 Sep 08 14:07:50.467003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 341/694] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:50 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:50.827537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:50.828222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:50.834589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.835603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.836047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.836782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:50.837243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:50.838554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:50.988737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:50.996678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ca3b2c1d-2e2e-4bcc-b31b-4472fd135533 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.173514 Sep 08 14:07:50.997252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 354/695] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:50 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:51.463093 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:51.467465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:51.472313 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.472899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.473338 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.474042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.474503 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.474957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.490452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:51.492039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:51.498351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.498897 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.508679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.509830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.510559 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.511198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.549999 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:51.553747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:51.554466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:51.554876 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:51.555328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'fault' on Instance uuid 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:51.558075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-45da8364-a53c-461a-b640-9f9601e3deff tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1245 microversion: 2.1 time: 0.103011 Sep 08 14:07:51.558998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 342/696] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:51 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:51.613050 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:51.634307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ffe1da1b-ab7e-4c46-ad92-337d4fb189c6 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 200 len: 1312 microversion: 2.1 time: 0.147497 Sep 08 14:07:51.635145 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 355/697] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:51 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:52.019582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:52.020406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:52.027483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.027973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.028442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.029149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.029609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.030087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.166746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:52.174474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-437df74a-979d-4e98-8d56-f5130c2c7eb1 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.158897 Sep 08 14:07:52.184726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 343/698] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:52 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:52.583506 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:52.584128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:52.590725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.591205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.591638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.592361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.592813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.593247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.658128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:52.661877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:52.662926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 20dfb69d-2dd9-4803-9a84-af1dd315f6c1] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:52.666268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-47a26183-d7b4-4877-9afc-3a3afc0f99e1 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1293 microversion: 2.1 time: 0.086538 Sep 08 14:07:52.666875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 356/699] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:52 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:52.668746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.669240 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.669681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.670385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.670844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.671269 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.687335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] HTTP exception thrown: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Request method failure captured: Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 HTTP/1.1 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXJoEaOlgKFoM9AgkAccLUDTEkz4oDr1gObZObhuPiKiHOchyMYcqKSMKpHM9_zgjn_Jj3-GkQBVSojGJ-gFroxtE7UIMPFlpPZUU_SI68BZdDBeOXqWbTY99O2UNQ0LcJld5Uc9nNvmTZ-7Mb-OjIy3Vyh4H82EUyDKmRtVNSHdiU Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:07:52.689067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_44e7a5fc099c4041aa1a3109962b5dc3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: a30b0734975d4e5a848be44aa7860807 Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. Sep 08 14:07:52.690614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '20dfb69d-2dd9-4803-9a84-af1dd315f6c1'} Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:07:52.691413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. Sep 08 14:07:52.692642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:07:52.693728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Returning 404 to user: Instance 20dfb69d-2dd9-4803-9a84-af1dd315f6c1 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:07:52.693728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-41c8f6b0-cadc-4bd6-9201-c13199ec2d99 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1" status: 404 len: 111 microversion: 2.1 time: 0.032804 Sep 08 14:07:52.693728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 344/700] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:52 2022] GET /compute/v2.1/servers/20dfb69d-2dd9-4803-9a84-af1dd315f6c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:07:52.701293 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:52.701782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:52.707805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.708335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.708769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.709455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:52.709959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:52.710386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:52.736941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:53.152872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e4e282db-ddfb-470e-a0fd-ebd60addcb3e tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 204 len: 0 microversion: 2.1 time: 0.455144 Sep 08 14:07:53.155235 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 357/701] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:52 2022] DELETE /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:07:53.162683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:53.163352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:53.169456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.169924 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.170362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.171080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.171547 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.171980 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.198225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:53.198824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:53.204979 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.205520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.205960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.206669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.207166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.207632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.360759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:53.369498 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7fb8e7cf-1642-4218-9717-b1feaeab0fb2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.210765 Sep 08 14:07:53.370090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 345/702] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:53 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:53.397508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:53.405407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-131e61ad-a007-45ab-b3d4-64e71b5a3c36 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.212259 Sep 08 14:07:53.405991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 358/703] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:53 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:53.691322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:53.691938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:53.699001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.699489 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.699920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.700639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:53.701095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:53.701517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:53.720227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:53.768299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:53.776129 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d5fc6012-caee-4fd3-908b-407f153d28ef tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1293 microversion: 2.1 time: 0.088680 Sep 08 14:07:53.776736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 346/704] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:53 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:54.398242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:54.399373 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:54.411038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.411785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.412641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.413873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.414585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.415362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.439224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:54.440079 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:54.449831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.450521 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.451088 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.451936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.452688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.453246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.635039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:54.643192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-096296f3-b453-48c7-b524-e60f0640eb26 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.252543 Sep 08 14:07:54.643768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 359/705] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:54 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:54.666512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:54.674719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4a6f273f-bb8e-4f0f-8f20-23a99de30eee tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.240822 Sep 08 14:07:54.675312 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 347/706] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:54 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:54.799997 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:54.800724 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:54.807649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.808238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.808785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.809535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:54.810101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:54.810579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:54.880719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:54.889407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-328873b8-7a3a-4898-b8f5-ebaf8e0b054c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1293 microversion: 2.1 time: 0.093374 Sep 08 14:07:54.889999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 360/707] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:54 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:55.337596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.338386 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.344888 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.345380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.345824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.346564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.347024 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.347450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.377446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:07:55.666457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.667085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.674035 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.674522 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.675052 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.675767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.677975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.677975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.687891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:55.792974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-097359d8-5d4d-4eb2-b89a-e0c1a0f19dc5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "DELETE /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 204 len: 0 microversion: 2.1 time: 0.459632 Sep 08 14:07:55.793881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 348/708] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:07:55 2022] DELETE /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:07:55.798958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.802598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.806926 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.807457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.808267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.809002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.809471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.809902 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.832101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:55.844312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dfc7105e-5046-42ed-a34c-19224a2609bb tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.181587 Sep 08 14:07:55.845153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 361/709] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:55 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:55.852269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.852903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.861850 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.862801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.863411 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.864259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.864735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.865171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.043060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:56.051581 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-20156a46-5936-4334-a94b-3b8f17b183ae tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.256689 Sep 08 14:07:56.052321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 349/710] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:55 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:56.074294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:56.074920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:56.076998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:56.081136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.081740 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.082166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.083074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.083716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.084375 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.087497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cc163c7c-5b27-49f2-8adf-08a282414b78 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1576 microversion: 2.1 time: 0.240880 Sep 08 14:07:56.088185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 362/711] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:55 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:56.150485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:56.159521 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-05bfdf0d-c223-47c1-9b3f-907857ef300e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1293 microversion: 2.1 time: 0.090220 Sep 08 14:07:56.160122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 350/712] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:56 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:56.882202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:56.883028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:56.889207 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.889730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.890147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.890891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.891365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.891825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.034139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.042215 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6918024e-91be-4676-b2c1-010ef469e4c8 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1521 microversion: 2.1 time: 0.165215 Sep 08 14:07:57.042804 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 363/713] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:56 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:57.083293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:57.084128 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:57.091562 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.092083 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.092611 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.093246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.093712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.094210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.119378 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:57.120511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:57.130866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.131794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.133620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.134980 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.135764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.136557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.338962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.354375 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.359587 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9c9d44a8-efa4-42db-a50c-e137296e5061 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1576 microversion: 2.1 time: 0.248262 Sep 08 14:07:57.361138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 364/714] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:57 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:57.362861 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-11aada9c-1bfc-45f8-87c2-b9dddd9ad53f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.283487 Sep 08 14:07:57.368886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:57.375690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:57.376555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 351/715] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:57 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:57.387344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:57.391626 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.392523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.393124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.394329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.395075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.395658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.395810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.396295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.396735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.410032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] Creating event network-vif-unplugged:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:07:57.417094 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-90cf6472-30d1-424f-951a-4d0d1b31064b req-237b7755-cd2b-446a-ae65-a260fa7e8de1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039187 Sep 08 14:07:57.418020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 352/716] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:57.513430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.525483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bacdeb82-e518-4c55-8f5e-a34d9704a46f tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1293 microversion: 2.1 time: 0.162426 Sep 08 14:07:57.526662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 365/717] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:57 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:58.068026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.068773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.076280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.076772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.077246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.078042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.078498 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.078924 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.146620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.156095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5f7a4849-a446-4512-8f83-0ab044cf69b9 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1479 microversion: 2.1 time: 0.092811 Sep 08 14:07:58.156737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 353/718] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1479 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:58.289085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef13e6e-be3d-4cf5-977c-08a0521e5190", "name": "network-vif-deleted", "tag": "a1b41d99-de62-4f6e-bc67-196b31315976"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:58.294981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:58.301251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.301806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.302380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.316166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] Creating event network-vif-deleted:a1b41d99-de62-4f6e-bc67-196b31315976 for instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 on hv-cinder-85646 Sep 08 14:07:58.324240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b655a4fa-897f-475b-9ea0-2a9653010325 req-42610a23-57b2-4b0e-b45b-4f4baf26a4da service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Sep 08 14:07:58.324240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 366/719] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:58.390256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.391122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.398457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.398957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.399386 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.400385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.401040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.401512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.408007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.411290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.423340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.423875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.428688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.428688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.428688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.428688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.701726 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.719335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-839a99fe-3ef1-49d0-aaf0-d4f2cd41490b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.333540 Sep 08 14:07:58.730569 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 354/720] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:58.735191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.738896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.744656 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.745581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b4b49ecc-451d-44ca-9009-7b62d3943eb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1576 microversion: 2.1 time: 0.354227 Sep 08 14:07:58.746760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 367/721] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1576 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:58.750881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.751373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.751811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.752556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.753331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.753331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.847309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.856893 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ba3a37c4-2beb-4312-a43e-240f46989c06 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1301 microversion: 2.1 time: 0.124906 Sep 08 14:07:58.857594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 355/722] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:59.187076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:59.187704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:59.194102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.195451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.195880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.196606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.197062 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.197487 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.202119 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:59.233233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.233718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.234151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.234599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lazy-loading 'fault' on Instance uuid 9ef13e6e-be3d-4cf5-977c-08a0521e5190 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:07:59.278109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30b0734975d4e5a848be44aa7860807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e7a5fc099c4041aa1a3109962b5dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:59.285986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b32f142f-b874-4cc8-b9d4-6fc4b7818ccc tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 200 len: 1311 microversion: 2.1 time: 0.102911 Sep 08 14:07:59.286569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 368/723] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:59.747414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:59.748132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:59.756615 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.757604 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.758380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.760182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.760772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.770274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:59.770888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:59.777447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.796486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.797372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.797986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.798959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.799586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.800243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.955112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:59.978943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e378bfd0-d8e7-4d31-9e55-19c8ade96c9b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1508 microversion: 2.1 time: 0.212218 Sep 08 14:07:59.981302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 369/724] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:00.003565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:00.005215 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:00.015147 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:00.023428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.025811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.026492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d3f5ea26-1ea1-4801-bd5e-4bef0d054cd4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1569 microversion: 2.1 time: 0.286427 Sep 08 14:08:00.026761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.027664 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.028430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.029075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.041779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 356/725] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:00.054218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:00.055451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:00.062832 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.063441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.064028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.065245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.071707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.071707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.113095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.132113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=10 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.141853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128401) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:08:00.159577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:00.169973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e675bae7-8f95-437d-8f9c-c0a524063a40 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1299 microversion: 2.1 time: 0.186027 Sep 08 14:08:00.171117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 370/726] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:00.317206 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:00.318692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] [instance: 9ef13e6e-be3d-4cf5-977c-08a0521e5190] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:00.334366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.337871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.338976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.341329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.342503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.343307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.404579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] HTTP exception thrown: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Request method failure captured: Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 HTTP/1.1 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXJoEaOlgKFoM9AgkAccLUDTEkz4oDr1gObZObhuPiKiHOchyMYcqKSMKpHM9_zgjn_Jj3-GkQBVSojGJ-gFroxtE7UIMPFlpPZUU_SI68BZdDBeOXqWbTY99O2UNQ0LcJld5Uc9nNvmTZ-7Mb-OjIy3Vyh4H82EUyDKmRtVNSHdiU Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:08:00.408878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/44e7a5fc099c4041aa1a3109962b5dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_44e7a5fc099c4041aa1a3109962b5dc3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 44e7a5fc099c4041aa1a3109962b5dc3 Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1160350264 Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: a30b0734975d4e5a848be44aa7860807 Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1160350264-project Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. Sep 08 14:08:00.410766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '9ef13e6e-be3d-4cf5-977c-08a0521e5190'} Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:00.411582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. Sep 08 14:08:00.413757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:00.418400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] Returning 404 to user: Instance 9ef13e6e-be3d-4cf5-977c-08a0521e5190 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:00.421211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-865a84cb-4c31-4ad9-8528-74a27b796ef2 tempest-ServerRescueNegativeTestJSON-1160350264 tempest-ServerRescueNegativeTestJSON-1160350264-project] 10.222.0.97 "GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190" status: 404 len: 111 microversion: 2.1 time: 0.115116 Sep 08 14:08:00.424763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 371/727] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:00 2022] GET /compute/v2.1/servers/9ef13e6e-be3d-4cf5-977c-08a0521e5190 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:00.444916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4be2d8-2899-4377-850f-21ed875432ab", "name": "network-vif-deleted", "tag": "7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:00.455839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:00.459020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.460725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.461375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.483053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] Creating event network-vif-deleted:7ce1fa4a-b6f7-4b4a-98fd-4c7ffcf8df04 for instance fa4be2d8-2899-4377-850f-21ed875432ab on hv-cinder-85646 Sep 08 14:08:00.489504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-209054ea-09d0-4e5d-abac-6fa03f0d5a49 req-4fb7ed5d-c183-412a-8f78-700cfe8248b2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053320 Sep 08 14:08:00.490372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 372/728] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:00.750295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0b677d16-c14d-4f5c-beb3-060db35959e9 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "POST /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529/action" status: 202 len: 0 microversion: 2.1 time: 0.700415 Sep 08 14:08:00.754206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 357/729] 10.222.0.97 () {60 vars in 1278 bytes} [Thu Sep 8 14:08:00 2022] POST /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:00.765737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:00.766471 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:00.784812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.785845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.785845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.786595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:00.787077 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:00.787510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.011833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:01.014776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:01.023844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.025511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.027513 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.030146 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.031152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.032202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.080354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:01.089270 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-33af454f-d1d9-4059-9434-35d88cfb3f5b tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1517 microversion: 2.1 time: 0.330555 Sep 08 14:08:01.093647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 373/730] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:00 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1517 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:01.141450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.142867 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.144325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.145655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lazy-loading 'fault' on Instance uuid fa4be2d8-2899-4377-850f-21ed875432ab {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:01.215391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:01.216015 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:01.228957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.231200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.231200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.231200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.231961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.232421 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.336204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:01.348829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f5b88eaf-171d-4ef8-8339-924fbd8f1496 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 200 len: 1228 microversion: 2.1 time: 0.344182 Sep 08 14:08:01.352399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 358/731] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:01 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 1228 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:01.589397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:01.599945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fe39c7b8-8a79-4545-99a0-63c05db27bb7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.388349 Sep 08 14:08:01.601423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 374/732] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:01 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:02.138488 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:02.139110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:02.148566 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.149064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.149571 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.150222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.150676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.151452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.398765 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:02.400551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:02.423113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.423809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.424448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.425395 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.426104 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.426871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.445063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] HTTP exception thrown: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Request method failure captured: Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab HTTP/1.1 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfZpqZqs1N7HMlfVrNpgCNt_OXDZMpRpqbbR6dp0zm9H-4ZTgIAOrfjyiMYNeoef3DiAt7HKsdD-hQ_sWKJOLW7NBLQKznZ5L_0m1lAOMzw4W20XfWcZ25-IUac_6JGBMF8G6gOYd0K-kEkPUynsPE_9ZKDycQ0sspdd2MwXokXokRI Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:08:02.446776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ae31829bffd7483fbab3dc87635aea58", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 26aa79753d6e4e49ad66cc32ba786fe8 Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:08:02.448133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'fa4be2d8-2899-4377-850f-21ed875432ab'} Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:02.449243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:08:02.450438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:02.451538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Returning 404 to user: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:02.451538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-576db90d-78b4-434a-9864-708580d037a5 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 404 len: 111 microversion: 2.1 time: 0.054391 Sep 08 14:08:02.451538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 375/733] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:02 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:02.525011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a8f44-cc1a-4595-b736-7222ad2085fb", "tag": "429d2f2c-ab68-486a-aeae-d65181cdc543"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:02.541680 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.542174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.542721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.563469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] Creating event network-changed:429d2f2c-ab68-486a-aeae-d65181cdc543 for instance f97a8f44-cc1a-4595-b736-7222ad2085fb on hv-cinder-85646 Sep 08 14:08:02.577841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-69daadc6-b9a6-4a3f-b7ac-3318f10c829e req-22cca6f2-8032-4414-8e7d-0a9539736723 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057915 Sep 08 14:08:02.580116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 376/734] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:02.632540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:02.636009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:02.639805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:02.652727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.653125 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.653285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c2ea7741-db2d-403d-959c-f2522b55a069 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1517 microversion: 2.1 time: 0.515074 Sep 08 14:08:02.653884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.654586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.655268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.655851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.662710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 359/735] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:02 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1517 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:02.694882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1232659626", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-23972180", "security_groups": [{"name": "tempest-secgroup-smoke-2101580619"}], "block_device_mapping_v2": [{"uuid": "7b4366b0-ec69-4165-9c7a-3118d671b122", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1825ab58-9a7f-4a28-9e67-c083bb9f8e93"}]}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:02.899245 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:02.907745 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7d39520e-a0bd-4e72-97ee-218593e10c6b tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.284183 Sep 08 14:08:02.909956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 377/736] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:02 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:02.935322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] validate_networks() for [('1825ab58-9a7f-4a28-9e67-c083bb9f8e93', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:08:03.646166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:08:03.647728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:08:03.648417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:08:03.648841 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:08:03.649263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:08:03.674405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.675200 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.675719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.676742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.678322 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.678957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.685190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:03.687570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:03.697585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.699097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.700183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.701456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.702378 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.705472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.724237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:08:03.730046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for user 26aa79753d6e4e49ad66cc32ba786fe8 and project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:08:03.822458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:08:03.825476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b4366b0-ec69-4165-9c7a-3118d671b122',volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:08:04.124975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:04.136989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ad259635-f8c1-4d65-9e4c-31e954edcbf7 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1517 microversion: 2.1 time: 0.457477 Sep 08 14:08:04.138776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 378/737] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:03 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:04.144166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:04.145142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:04.152127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.152779 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.153333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.154891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.155470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.156128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.353157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:04.368573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-24a54014-0750-424f-b9a9-2c0832d600d2 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.227830 Sep 08 14:08:04.369555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 379/738] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:04 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:04.556300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6b722e1b-ae65-4ccc-841f-46e24d19eef9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.866082 Sep 08 14:08:04.565140 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 360/739] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:08:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:08:04.570429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-23db9580-62bf-4ab9-b87b-e18e07b0e81b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:04.571105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-23db9580-62bf-4ab9-b87b-e18e07b0e81b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:04.656345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-23db9580-62bf-4ab9-b87b-e18e07b0e81b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:04.665236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-23db9580-62bf-4ab9-b87b-e18e07b0e81b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1093 microversion: 2.1 time: 0.099746 Sep 08 14:08:04.674333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 380/740] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:04 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:05.163290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:05.163921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:05.174001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.177910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.179008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.179940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.180597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.181035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.229549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:05.395957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:05.396639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:05.412780 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.413350 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.413821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.418775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.419473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.419998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.460029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:05.471970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-49e0f146-2389-4854-be5e-0f3326912725 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1519 microversion: 2.1 time: 0.311824 Sep 08 14:08:05.473269 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 361/741] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:05 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:05.659869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:05.669686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b03f06d9-3365-496b-927d-030e6df74da0 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.278005 Sep 08 14:08:05.670262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 381/742] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:05 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:05.689177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6493ca3a-217e-4184-82af-53621fa6b30a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:05.689830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6493ca3a-217e-4184-82af-53621fa6b30a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:05.748391 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6493ca3a-217e-4184-82af-53621fa6b30a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:05.756775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6493ca3a-217e-4184-82af-53621fa6b30a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1093 microversion: 2.1 time: 0.070933 Sep 08 14:08:05.757788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 362/743] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:05 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:06.508121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:06.511133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:06.525662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.526211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.528849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.534649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.534649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.540084 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.694689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:06.704600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:06.704600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.704600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.704600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.705197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.705197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.705197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.710479 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:06.718885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0c3c8084-5cf4-4564-9bd0-3d7636df16db tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.218036 Sep 08 14:08:06.719549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 382/744] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:06 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:06.781548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:06.782427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:06.792365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.792916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.793898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.795388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:06.796392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:06.797444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.889493 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:06.898868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:06.900552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7607026a-71fb-49b6-8901-cf645cbaa229 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1135 microversion: 2.1 time: 0.123169 Sep 08 14:08:06.905211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 383/745] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:06 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1135 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:06.907477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a2abd676-60ec-4f98-bc28-54de2614a07a tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.218647 Sep 08 14:08:06.908050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 363/746] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:06 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:07.453122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a8f44-cc1a-4595-b736-7222ad2085fb", "name": "network-vif-plugged", "status": "completed", "tag": "429d2f2c-ab68-486a-aeae-d65181cdc543"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:07.463663 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.464269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.464947 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.477631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] Creating event network-vif-plugged:429d2f2c-ab68-486a-aeae-d65181cdc543 for instance f97a8f44-cc1a-4595-b736-7222ad2085fb on hv-cinder-85646 Sep 08 14:08:07.483015 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-1a2ca24b-4b37-47d9-9d2d-4fefb66acbe8 req-290ce36a-8dac-422b-959d-fee2cbee264e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Sep 08 14:08:07.483681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 384/747] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:07.744464 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:07.745116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:07.752347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.752850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.753293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.754054 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.754523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.754955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.909545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:07.918448 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fff26fa8-6288-4ee0-b416-3590b4e7baa0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.178601 Sep 08 14:08:07.919046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 364/748] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:07 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:07.926784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:07.927606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:07.934549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.935037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.935472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.936229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.936366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:07.936653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.936905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:07.937080 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.943193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.948340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.948340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.948340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.948340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.948684 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.031545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:08.038952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ac85c514-1c1a-4110-a03d-ec073e3dd23a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1191 microversion: 2.1 time: 0.116918 Sep 08 14:08:08.039532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 385/749] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:07 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:08.132616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:08.134963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6e7100fd-62ec-4208-b0aa-f9a87184c073 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.202929 Sep 08 14:08:08.136268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 365/750] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:07 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:08.945827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:08.946424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:08.953386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.953891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.954310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.955014 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.955478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.955917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.067410 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:09.069341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:09.076745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.077529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.078228 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.079245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.079752 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.080329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.129542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:09.139929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fc22f366-32f7-4f8f-a2dc-3d8ba67cdaa2 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.198611 Sep 08 14:08:09.141767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 386/751] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:08 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:09.161315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:09.161730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:09.179268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:09.179394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.179394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.179394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.179394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.179738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.179738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.179900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7973b4ba-27ef-4fe1-806a-8974a911f106 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1199 microversion: 2.1 time: 0.113912 Sep 08 14:08:09.179900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 366/752] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:09 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:09.319777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:09.329244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c3652870-28b3-46b4-bc05-240329d58807 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.172827 Sep 08 14:08:09.342068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 387/753] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:09 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:09.384657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:09.385155 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:09.391220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.391701 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.392168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.392897 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.393345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.393851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.420789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8fd583cb-6bdf-4d35-abc2-dfc1a37b877d tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/ips" status: 200 len: 146 microversion: 2.1 time: 0.040748 Sep 08 14:08:09.421390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 367/754] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:08:09 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:08:10.181782 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:10.183326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:10.200549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.202043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.204242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.207014 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.207582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.208039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.213005 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:10.220865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:10.234109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.234791 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.235244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.236044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.247364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.248085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.373813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:10.382904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e6e5e025-3fcf-42ae-b8a2-94454f98d01c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1209 microversion: 2.1 time: 0.177563 Sep 08 14:08:10.383497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 368/755] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:10 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1209 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:10.388794 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:10.389415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:10.395519 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.396081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.397302 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.398077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.398633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.399168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.555170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:10.558884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:10.570960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f95972c9-f5d2-4bbc-a503-0c3fb511fe1f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.405624 Sep 08 14:08:10.580854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 388/756] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:10 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:10.938343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:10.949967 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c4dbeee0-b1c9-4d07-991c-6ae7cf1cc949 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1366 microversion: 2.1 time: 0.565323 Sep 08 14:08:10.950718 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 369/757] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:10 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:11.379703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50bcfb98-6fc1-4a32-8c9d-1a87562963bd"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:11.381409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.388811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.389231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.389774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.390494 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.390958 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.391460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.406990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:11.407597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.414864 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.415345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.415779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.416503 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.416958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.417379 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.563965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:11.573003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f08d4d3d-c5db-4680-8094-229799f8dbb9 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1277 microversion: 2.1 time: 0.169774 Sep 08 14:08:11.573596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 370/758] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:11 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:11.632825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:11.638911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.653903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.654886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.655679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.657085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.660760 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.660760 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.843001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:11.852484 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f11ac6f7-4ec5-46cf-a9f9-5fa14bb6a48f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.225893 Sep 08 14:08:11.853169 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 371/759] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:11 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:11.976986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:11.977980 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.984690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.985441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.986245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.987528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.988318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.990959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.169757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:12.178749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-acabd3d3-5ff7-4689-bba3-33d30b1023a6 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1554 microversion: 2.1 time: 0.207340 Sep 08 14:08:12.179329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 372/760] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:11 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:12.184438 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084bd4fc-4a10-484c-88ff-10c94f46b7ea", "tag": "eb033f6b-f0b8-45fb-be20-a16573012b2c"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:12.195099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.196027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.197190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.209032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] Creating event network-changed:eb033f6b-f0b8-45fb-be20-a16573012b2c for instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea on hv-cinder-85646 Sep 08 14:08:12.214924 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-0289e6e1-a771-4467-b82e-4827d6189ba9 req-22e4d29b-34ae-422a-9006-05d6dee1cb55 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Sep 08 14:08:12.216034 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 373/761] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:12.221731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:12.222321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:12.229397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.234206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.234206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.234206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.234206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.234580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.416577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e688654a-ff00-4091-a81c-e1c577db93fa tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198967 Sep 08 14:08:12.418104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 374/762] 10.222.0.97 () {58 vars in 1275 bytes} [Thu Sep 8 14:08:12 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:12.563372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e3fef1f4-97aa-49bf-8399-c23030da3d00 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.187415 Sep 08 14:08:12.585865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 389/763] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:08:11 2022] POST /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 194 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:12.598435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:12.599408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:12.614590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.615103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.615575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.616337 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.616795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.617452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.878313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:12.879019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:12.885420 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.885916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.886380 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.887138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:12.887687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:12.888171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.022813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.038505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bae230f9-b3ac-4f67-8d90-75747fb5a482 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.443856 Sep 08 14:08:13.039270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 375/764] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:12 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:13.261169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.273662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1fc409f9-8d82-4132-b990-5298d372f440 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.400062 Sep 08 14:08:13.280381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 390/765] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:12 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:14.062277 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:14.063651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:14.066750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:14.072908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.073411 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.074063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.074840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.075550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.076190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.301267 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:14.301971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:14.311747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.312499 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.313141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.314063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:14.314754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:14.315374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:14.534386 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:14.542728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-220c5753-f7e3-41db-8826-2819e9035593 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.484480 Sep 08 14:08:14.543420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 376/766] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:14 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:14.660118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:14.662984 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:14.669939 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-25203ea8-d6a9-4f4b-af99-0061795eb893 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.376025 Sep 08 14:08:14.670530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 391/767] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:14 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:15.135199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a8f44-cc1a-4595-b736-7222ad2085fb", "tag": "429d2f2c-ab68-486a-aeae-d65181cdc543"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:15.152487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.153351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.154103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.171713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] Creating event network-changed:429d2f2c-ab68-486a-aeae-d65181cdc543 for instance f97a8f44-cc1a-4595-b736-7222ad2085fb on hv-cinder-85646 Sep 08 14:08:15.177043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-5cb512f3-3c33-4f7b-824d-2114ed43ca40 req-f584fe72-02bd-41fd-b703-26a611a8b1e2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200996 Sep 08 14:08:15.178193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 377/768] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:15.567152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:15.569072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:15.579492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.580546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.581241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.582296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.583594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.585070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.696469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:15.697586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:15.710147 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.714359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.715204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.716338 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:15.717281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:15.719168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:15.756657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:15.994971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:16.020264 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7a0bd0d0-2033-4693-99c1-7c34964e4005 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.445452 Sep 08 14:08:16.020264 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 392/769] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:15 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:16.172896 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:16.183463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-baa9c86a-cbf9-45a7-9c98-8141ada8597c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.491507 Sep 08 14:08:16.188029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 378/770] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:15 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:17.062248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:17.067371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:17.093574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.094786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.095427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.096422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.098008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.098703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.233296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:17.234040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:17.253570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.254557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.256315 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.257365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:17.257977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:17.258536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:17.621746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:17.640644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:17.641035 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-48df63c3-27aa-4538-992e-c14315489f72 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.584589 Sep 08 14:08:17.649317 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-db7c636d-a7c1-481a-a87e-7ebc6c6c0eeb tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.422705 Sep 08 14:08:17.649823 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 379/771] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:17 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:17.654506 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 393/772] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:17 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:18.649386 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7f9b0680-16c3-4eb3-8154-2896f1e123e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: .version_select at 0x7f7f8b117670>, body: {"keypair": {"name": "tempest-keypair-1388624436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWy6ncLYnWHdysOeM0BVaTsqOP9C4SW2PSP28z9P2J3bFZW8ErIsfct0IKe2YDfA1N+sJbryiAyzqp65GG+5uiLAR1GKIAiSGH9RP+sxSDp0K9iFge3Bo36oK2A2sEHgg=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:18.665664 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-7f9b0680-16c3-4eb3-8154-2896f1e123e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for project 1abe0ab206094524af0fdde9e6285385. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:08:18.668629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:18.669422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:18.669922 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-7f9b0680-16c3-4eb3-8154-2896f1e123e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for user f5e920d3b3044859b767add41690043c and project 1abe0ab206094524af0fdde9e6285385. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:08:18.675881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.676394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.676824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.678019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.678469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.678893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.687440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:18.761940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7f9b0680-16c3-4eb3-8154-2896f1e123e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.167366 Sep 08 14:08:18.762592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 380/773] 10.222.0.97 () {62 vars in 1200 bytes} [Thu Sep 8 14:08:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 14:08:18.775789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:18.775789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:18.777862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.777862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.777862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.778278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:18.778646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:18.779076 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:18.875637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:18.885705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e3507b31-6d4d-4db2-9a2d-81ea659ab19a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.220844 Sep 08 14:08:18.886797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 394/774] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:18 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:18.948894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:18.960890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-677a19d1-bd54-4fa8-af79-793772315bf3 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.197138 Sep 08 14:08:18.961876 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 381/775] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:18 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:19.457621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "name": "network-vif-plugged", "status": "completed", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:19.468805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.469154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.470049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:19.482508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] Creating event network-vif-plugged:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:08:19.487530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-667b1985-0107-4906-b87f-09277fb846b6 req-4ab30c38-1f5b-4228-99d9-efe2d632fb7e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Sep 08 14:08:19.488381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 395/776] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:19.910310 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:19.911099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:19.918277 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.918895 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.919463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:19.920284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.920811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.921476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:19.926067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:19.987590 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:19.988327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:19.997572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:19.998222 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:19.998959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:20.000051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:20.001324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:20.001896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:20.108709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:20.117633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-49748cff-1fab-4926-a076-f441b10c4fad tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.211770 Sep 08 14:08:20.118224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 382/777] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:19 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:20.170269 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:20.179009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-039e3aa2-2720-4b05-9d6d-0737a7c9bb1c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.197165 Sep 08 14:08:20.179582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 396/778] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:19 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:21.147969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:21.149452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:21.160877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.160877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.160877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.160877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.161406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.161406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.204089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:21.205298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:21.215956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.216472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.216904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.220800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.221291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.229901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.526973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:21.537442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4c3ce0df-656c-407d-8ef3-79a78773594a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.394976 Sep 08 14:08:21.538687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 383/779] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:21 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:21.544530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:21.549394 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:21.554640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.555131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.555565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.556334 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.556824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.557245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.593427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:21.597847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-dd31f281-6a0b-419a-8f13-4f74bd4607d1 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057830 Sep 08 14:08:21.600759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 384/780] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:08:21 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:21.607708 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4fbe9de4-3c03-4ab3-8746-e4547b2e38f4 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1575 microversion: 2.1 time: 0.407816 Sep 08 14:08:21.613083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 397/781] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:21 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1575 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:21.628434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:21.629108 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:21.636493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.637293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.637879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.639008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:21.639797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:21.640418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:21.679065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6380e131-c8c1-40b8-acbc-3a6d6057e001 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd" status: 200 len: 194 microversion: 2.1 time: 0.063214 Sep 08 14:08:21.680453 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 385/782] 10.222.0.97 () {58 vars in 1413 bytes} [Thu Sep 8 14:08:21 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:22.185027 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1071832737", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d613c6-35b4-42be-b5d3-ee46e5ddc1e5"}], "security_groups": [{"name": "tempest-securitygroup--1731041208"}], "key_name": "tempest-keypair-1388624436", "user_data": "}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:22.320818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] validate_networks() for [('78d613c6-35b4-42be-b5d3-ee46e5ddc1e5', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:08:22.559723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:22.560395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:22.567314 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.567900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.568843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.569810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.570311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.570739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.819046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:22.828052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9467acfc-e32a-4c52-971f-0faf172d87b0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.272134 Sep 08 14:08:22.828894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 386/783] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:22 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:22.833793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:22.834658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:22.841367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.841879 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.842318 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.843021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.843485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.843916 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.878112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:08:22.878539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:08:22.879343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:08:22.879755 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:08:22.880252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:08:22.890382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.890874 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.891309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.892036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:22.892597 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:22.892944 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:22.910537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for project 1abe0ab206094524af0fdde9e6285385. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:08:22.915509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for user f5e920d3b3044859b767add41690043c and project 1abe0ab206094524af0fdde9e6285385. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:08:22.927212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:08:22.930067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:08:22.985371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:22.994157 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-54218919-9ca4-41a0-9766-23d628ffdc7f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1562 microversion: 2.1 time: 0.164085 Sep 08 14:08:22.994781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 387/784] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:22 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:23.141360 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f781314b-75fb-4c3f-81fe-a7048b0e2ecd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.964608 Sep 08 14:08:23.141931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 398/785] 10.222.0.97 () {62 vars in 1188 bytes} [Thu Sep 8 14:08:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 14:08:23.154388 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:23.155385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:23.231904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:23.239850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:23.242260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:23.243466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-586078dd-4bf9-4892-ad49-bc0b16517889 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1282 microversion: 2.20 time: 0.093515 Sep 08 14:08:23.244289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 388/786] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:23 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:23.500932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec9a534-ebc5-4565-8d73-f379d88f3340"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:23.503610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:23.515227 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.516296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.516826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.517579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.518306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.518671 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.527195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084bd4fc-4a10-484c-88ff-10c94f46b7ea", "name": "network-vif-plugged", "status": "completed", "tag": "eb033f6b-f0b8-45fb-be20-a16573012b2c"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:23.539424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.540199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.540638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.552505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] Creating event network-vif-plugged:eb033f6b-f0b8-45fb-be20-a16573012b2c for instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea on hv-cinder-85646 Sep 08 14:08:23.558473 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-30f83711-20d4-4e40-91e3-666702674b02 req-86a49004-71e6-475c-8ade-e99fd0710c89 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Sep 08 14:08:23.559549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 389/787] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:23.867767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:23.868540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:23.874640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.875332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.875762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:23.876480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:23.876928 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:23.877368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:24.018509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:24.026357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5497413b-7556-44fa-bd9a-98336e5bd74b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.163790 Sep 08 14:08:24.026936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 390/788] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:23 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:24.270095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:24.270710 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:24.325010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:24.332950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:24.334463 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:24.335578 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8cb2e294-5bf1-42d7-b4fe-a6ba4f8b495b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1282 microversion: 2.20 time: 0.069530 Sep 08 14:08:24.336163 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 391/789] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:24 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:08:24.556828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-adae0c47-782d-4dea-adc8-5025804aec15 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "POST /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.060749 Sep 08 14:08:24.561653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 399/790] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:08:23 2022] POST /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:25.050358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:25.051012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:25.060237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:25.060739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:25.061165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:25.062020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:25.062696 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:25.063131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:25.206115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:25.214586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a567f14c-f3df-4a8b-af38-351cd3044409 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1265 microversion: 2.1 time: 0.168173 Sep 08 14:08:25.214952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 392/791] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:25 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:25.362062 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:25.362761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:25.370186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:25.370674 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:25.371111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:25.371811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:25.372328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:25.372764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:25.439805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:25.449239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:25.450725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:25.451917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8362daa5-5f0c-4014-b228-4fd454fac24a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1278 microversion: 2.20 time: 0.094328 Sep 08 14:08:25.452594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 400/792] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:25 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:08:26.236633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:26.237323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:26.244286 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.244789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.245226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.246198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.246466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.246901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.384798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:26.392601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2fc68c1e-2f84-4d6e-88f1-e3eb1e1f5f6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1452 microversion: 2.1 time: 0.159818 Sep 08 14:08:26.393182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 393/793] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:26 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:26.417593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:26.418211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:26.424393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.424891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.425399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.426038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.426504 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.426951 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.478634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:26.479293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:26.485712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.486211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.486730 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.487389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:26.487937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:26.488613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:26.565112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:26.575850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:26.577576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:26.578750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-267a2028-8418-4bb9-91f9-070e3e36ca88 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1334 microversion: 2.20 time: 0.104949 Sep 08 14:08:26.579325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 394/794] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:26 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:08:26.601994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:26.610352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bc0d3e81-c899-4fab-8506-d8227acf2f9c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1452 microversion: 2.1 time: 0.197313 Sep 08 14:08:26.610938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 401/795] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:26 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:27.610399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:27.611681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:27.623622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:27.624563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:27.625616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:27.626903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:27.627987 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:27.629904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:27.698574 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:27.707334 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:27.709390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:27.710495 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-33fdac2d-6c52-47b1-8355-042493e8bdbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1342 microversion: 2.20 time: 0.108463 Sep 08 14:08:27.711051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 395/796] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:27 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:28.742403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:28.743125 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:28.749881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:28.750449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:28.750965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:28.751739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:28.752307 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:28.752816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:28.925385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:28.936943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:28.938488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:28.940240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d43264d3-67a1-45a7-87d0-02d188071283 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.202554 Sep 08 14:08:28.940240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 402/797] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:28 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:29.372157 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084bd4fc-4a10-484c-88ff-10c94f46b7ea", "tag": "eb033f6b-f0b8-45fb-be20-a16573012b2c"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:29.382543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:29.383418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:29.384074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:29.396773 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] Creating event network-changed:eb033f6b-f0b8-45fb-be20-a16573012b2c for instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea on hv-cinder-85646 Sep 08 14:08:29.401619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-239ceb80-8d89-455c-a742-358e355a50a7 req-b66abea2-3545-48ea-bc7c-0e56d42c8e9d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033394 Sep 08 14:08:29.402224 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 396/798] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:29.973571 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:29.975116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:29.977630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:29.983100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:29.983681 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:29.986633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:29.986633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:29.986633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:29.986633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:30.141443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:30.151283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:30.153589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:30.154769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d03ff717-3640-4f1a-a963-dfe2f03d48c8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.185190 Sep 08 14:08:30.156243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 403/799] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:29 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:31.179910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:31.180858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:31.187247 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:31.187736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:31.188182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:31.188889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:31.189340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:31.189767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:31.323645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:31.331764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:31.333921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:31.335034 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6cec6c80-12e9-4bc4-9892-110ac06efa6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.159902 Sep 08 14:08:31.335600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 397/800] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:31 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:31.420832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:31.431349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:31.431813 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:31.432268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:31.436081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:31.443734 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] Creating event network-changed:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:08:31.448840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-b1c8bce1-76f8-41d7-83e1-238f66ca8fb2 req-8e8898c9-919e-4b89-af30-d26ffc8a9193 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031695 Sep 08 14:08:31.449436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 404/801] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:32.360180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:32.360836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:32.367300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:32.367781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:32.368302 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:32.369009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:32.369465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:32.369891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:32.499910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:32.508546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:32.510174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:32.511280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cc72a034-8959-41b5-9cf5-e0c53c7ab20b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.155063 Sep 08 14:08:32.511848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 398/802] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:32 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:33.534368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:33.535143 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:33.539931 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:33.540667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:33.547532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:33.548009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:33.548512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:33.549200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:33.549650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:33.550070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:33.688852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:33.698036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:33.699481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:33.700679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dbb5a105-afc5-466b-b616-b23022132b40 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.167718 Sep 08 14:08:33.701243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 405/803] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:33 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:34.728124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:34.728779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:34.731307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=8 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:34.736198 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:34.736742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:34.738316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:34.738316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:34.738837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:34.739360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:34.870285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:34.878512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:34.880498 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:34.881619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1815a3d9-5fcd-4d08-967c-15a1046d4fd3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.157984 Sep 08 14:08:34.882188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 399/804] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:34 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:35.343666 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:35.345984 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:35.352993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.353492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.353932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.354639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.355101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.355528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.390564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-84b8d7d5-34f3-42e7-8041-dc280ae80b83 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050976 Sep 08 14:08:35.391523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 406/805] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:08:35 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:35.545284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:35.546061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:35.550555 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "name": "network-vif-plugged", "status": "completed", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:35.558132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.558977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.560017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.561400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.562056 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.562682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.565910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.566959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.567683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.583221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] Creating event network-vif-plugged:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:08:35.589806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-44cf8115-fc79-4834-9267-90a1ccc44b13 req-83e2f8ad-bcdf-4286-a6cc-e2053425d162 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046143 Sep 08 14:08:35.591337 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 407/806] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:35.620076 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1a25bf98-c6df-44ea-89d1-1e3b62ba9d1c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd" status: 200 len: 194 microversion: 2.1 time: 0.080865 Sep 08 14:08:35.626393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 400/807] 10.222.0.97 () {58 vars in 1413 bytes} [Thu Sep 8 14:08:35 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:35.634453 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:35.635047 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:35.642444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.642937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.643376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.644094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.644592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.645030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.807631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lazy-loading 'services' on Instance uuid aab21e8a-b3f7-498c-9b87-f504625d8f62 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:35.907254 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:35.907997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:35.915491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.915976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.916587 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:35.917304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:35.917756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:35.918885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:36.071098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:36.086863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:36.088840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:36.090296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e552ef50-8155-4648-9954-74824281fb05 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.187241 Sep 08 14:08:36.090921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 401/808] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:35 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:08:36.134568 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-78580011-bd3d-4fce-93ef-76d1cc6dedae tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd" status: 202 len: 0 microversion: 2.1 time: 0.505868 Sep 08 14:08:36.139457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 408/809] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:08:35 2022] DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/50bcfb98-6fc1-4a32-8c9d-1a87562963bd => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:37.117620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:37.118242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:37.125007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:37.125642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:37.125985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:37.126681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:37.127144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:37.127576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:37.131887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:37.259906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:37.268227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:37.269774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:37.270986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-622e0751-168c-4c17-8167-2467d6a9752c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1408 microversion: 2.20 time: 0.157981 Sep 08 14:08:37.271635 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 402/810] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:37 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:38.298530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:38.299156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:38.306651 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:38.307144 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:38.307583 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:38.308393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:38.308822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:38.309258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:38.467477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:38.477702 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:38.479169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:38.480682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9ecbc4cb-3265-4f94-a725-8df275674dc9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1599 microversion: 2.20 time: 0.187282 Sep 08 14:08:38.481646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 409/811] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:08:38 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:08:38.506117 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:38.506708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:38.513259 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:38.513736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:38.514177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:38.514868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:38.515321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:38.515749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:38.601877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-690a5a4d-0f80-4fb5-9a7e-bb17512e62fc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099626 Sep 08 14:08:38.602822 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 403/812] 10.222.0.97 () {60 vars in 1316 bytes} [Thu Sep 8 14:08:38 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 14:08:39.812632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:39.825992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:39.826936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:39.828319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:39.843279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] Creating event network-changed:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:08:39.849586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-449d83a1-1041-4917-8286-15050efae3fa req-1af459f0-8d31-4287-81a4-d905dc8438ba service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040115 Sep 08 14:08:39.850266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 410/813] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:40.535540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:40.538742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:40.543267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:40.543767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:40.544344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:40.545099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:40.545625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:40.546204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:40.584637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-260229ff-8aaa-4f05-b356-715f928d0835 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/aec9a534-ebc5-4565-8d73-f379d88f3340" status: 200 len: 194 microversion: 2.1 time: 0.056196 Sep 08 14:08:40.585476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 404/814] 10.222.0.97 () {58 vars in 1413 bytes} [Thu Sep 8 14:08:40 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/aec9a534-ebc5-4565-8d73-f379d88f3340 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:40.597705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:40.598645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:40.605887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:40.606383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:40.606829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:40.607557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:40.608022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:40.608518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:40.702570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lazy-loading 'services' on Instance uuid aab21e8a-b3f7-498c-9b87-f504625d8f62 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:40.933747 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fe1ee748-746d-4278-b3b7-6987d979db5b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/aec9a534-ebc5-4565-8d73-f379d88f3340" status: 202 len: 0 microversion: 2.1 time: 0.340328 Sep 08 14:08:40.935428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 411/815] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:08:40 2022] DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments/aec9a534-ebc5-4565-8d73-f379d88f3340 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:43.214050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.216380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:43.224982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.225476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.225922 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.226631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.227098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.227526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.264225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0df2f4bb-9daa-4261-9a70-372c53fa4f2e tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056607 Sep 08 14:08:43.264827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 405/816] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:08:43 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:08:43.389393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.391784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:43.399121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.399608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.400042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.400774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.401230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.401654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.433382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c62b64c8-0fd8-4d22-a974-cb58486000a9 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049078 Sep 08 14:08:43.433970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 412/817] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:08:43 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:08:43.502691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.503206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:43.509641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.510132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.512121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.512121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.512121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.512457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.547384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:08:43.932344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d1fcfd8b-a639-4cc3-812c-e4242064c4d0 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 204 len: 0 microversion: 2.1 time: 0.433435 Sep 08 14:08:43.932953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 406/818] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:08:43 2022] DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:08:43.941659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:43.942267 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:43.949008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.952253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.952253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:43.952253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:43.952253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:43.952656 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:44.099589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:44.108956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f22ecfa5-ede6-4d77-9e2f-b98720d11278 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1675 microversion: 2.1 time: 0.170972 Sep 08 14:08:44.109549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 413/819] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:43 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:45.135316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:45.136026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:45.143135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:45.143632 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:45.144072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:45.144807 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:45.146675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:45.146675 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:45.290033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:45.300261 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-74988850-7b0c-4a90-abcd-ed65c17eb87a tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1675 microversion: 2.1 time: 0.168857 Sep 08 14:08:45.300913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 407/820] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:45 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:46.328363 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:46.328999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:46.336714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.337212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.337661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.338382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:46.338845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:46.339273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:46.521033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:46.529414 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e6ebdb49-c3b0-42bf-9be5-2bf68f7a8913 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1675 microversion: 2.1 time: 0.205003 Sep 08 14:08:46.530009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 414/821] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:46 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:47.262641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab21e8a-b3f7-498c-9b87-f504625d8f62", "name": "network-vif-deleted", "tag": "e902e854-c899-4f4c-866d-e8871faa861d"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:47.275199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.275731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.276174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.288248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] Creating event network-vif-deleted:e902e854-c899-4f4c-866d-e8871faa861d for instance aab21e8a-b3f7-498c-9b87-f504625d8f62 on hv-cinder-85646 Sep 08 14:08:47.300482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-6e313530-7bc1-478d-98e1-535c6bba87d7 req-2fe62acc-7de1-411d-b42b-8ea4e19eab8a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041211 Sep 08 14:08:47.301350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 408/822] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:47.555174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:47.555744 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:47.563280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.563685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.564127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.564873 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.565324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.565911 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.638566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:47.665628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cd7b4d50-bd07-48cf-a5c5-f99748457699 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1323 microversion: 2.1 time: 0.114748 Sep 08 14:08:47.666750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 415/823] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:47 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:48.697037 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:48.697920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:48.705822 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.706368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.707000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.708405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.708875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.709296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.749844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.750327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.750756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.751199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lazy-loading 'fault' on Instance uuid aab21e8a-b3f7-498c-9b87-f504625d8f62 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:48.803436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dc6b5898c4e1aae71a028b4840bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ba0ac1c50e4802b8c055a9b3075022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:48.812884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1325017d-ed5c-4c78-ab73-fdce4b66a56c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 200 len: 1328 microversion: 2.1 time: 0.121231 Sep 08 14:08:48.813494 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 409/824] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:48 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:49.847121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:49.847726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:49.854963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.855447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.855889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.856614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.857128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.857587 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.872467 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 HTTP/1.1 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:08:49.874115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:49.875881 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'aab21e8a-b3f7-498c-9b87-f504625d8f62'} Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:49.877183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:49.878803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:49.880884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:49.880884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6b40767b-d327-4661-8bc6-6e7ccb796b3b tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 404 len: 111 microversion: 2.1 time: 0.032473 Sep 08 14:08:49.880884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 416/825] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:49 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:49.885649 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-83acdc3a-361e-4c9a-bdf0-e3921a6f3162 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '.version_select at 0x7f7f8aec3b80>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:49.999050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-83acdc3a-361e-4c9a-bdf0-e3921a6f3162 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212275921" status: 202 len: 0 microversion: 2.1 time: 0.117154 Sep 08 14:08:49.999975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 410/826] 10.222.0.97 () {58 vars in 1221 bytes} [Thu Sep 8 14:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212275921 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:53.426727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:53.427312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:53.434296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.434793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.435237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.435994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.436491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.436926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.451393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 HTTP/1.1 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:08:53.453031 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.454675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'aab21e8a-b3f7-498c-9b87-f504625d8f62'} Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:53.455637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.457987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.459705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:53.459705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-acfd6ea8-8dea-4513-bea6-7127f6ab4592 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 404 len: 111 microversion: 2.1 time: 0.032471 Sep 08 14:08:53.459705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 417/827] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:08:53 2022] DELETE /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:53.464376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:53.464986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: aab21e8a-b3f7-498c-9b87-f504625d8f62] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:53.467661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:53.473942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.474436 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.481007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.481007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:53.481007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:53.481007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:53.490272 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 HTTP/1.1 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:08:53.491950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.493800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'aab21e8a-b3f7-498c-9b87-f504625d8f62'} Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:53.494814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. Sep 08 14:08:53.496339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:53.497749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance aab21e8a-b3f7-498c-9b87-f504625d8f62 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:53.497749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5cc959bd-acf7-40d0-a5dc-067b36e168e5 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62" status: 404 len: 111 microversion: 2.1 time: 0.033073 Sep 08 14:08:53.497749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 411/828] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:53 2022] GET /compute/v2.1/servers/aab21e8a-b3f7-498c-9b87-f504625d8f62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:54.777376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:54.777982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:54.784749 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.785862 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.786309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.787005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.787455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.787880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.802064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b HTTP/1.1 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:08:54.803617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.805335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '7fec36d5-04f6-46ec-8406-004966e4e97b'} Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:54.806849 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.809274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.811535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:54.811535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d4e336c1-22e4-4262-a24c-9f397c8ae850 tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 404 len: 111 microversion: 2.1 time: 0.031581 Sep 08 14:08:54.811535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 418/829] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:08:54 2022] DELETE /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:54.813595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:54.814211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] [instance: 7fec36d5-04f6-46ec-8406-004966e4e97b] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:54.821518 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.821992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.822428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.823103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:54.823553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:54.823975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:54.837549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] HTTP exception thrown: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Request method failure captured: Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b HTTP/1.1 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXRMk4ypis-XiUQ115eVoKxMJ7ZyVua8JNKPRmeIY56vbsNdF9JdoVb4L7LWLYoAGcC2UJUjVXTC6LbDZoKxvrqGTSE2mVdnNPyM4tXOOJiK1MoiOC22hVlksTgyRZ7Sz85UyOzi7CZ6yKf5evp5A_9FZ7WRDOf4qVIKNpVci3LY5Y Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:08:54.839459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/73ba0ac1c50e4802b8c055a9b3075022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_73ba0ac1c50e4802b8c055a9b3075022", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 73ba0ac1c50e4802b8c055a9b3075022 Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1546889007 Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c18dc6b5898c4e1aae71a028b4840bf0 Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeTestJSON-1546889007-project Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.841072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '7fec36d5-04f6-46ec-8406-004966e4e97b'} Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:54.842126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. Sep 08 14:08:54.843563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:08:54.845121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] Returning 404 to user: Instance 7fec36d5-04f6-46ec-8406-004966e4e97b could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:54.845121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cc692966-7b0c-4c49-8744-6d3afc77d18c tempest-AttachVolumeTestJSON-1546889007 tempest-AttachVolumeTestJSON-1546889007-project] 10.222.0.97 "GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b" status: 404 len: 111 microversion: 2.1 time: 0.030731 Sep 08 14:08:54.845121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 412/830] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:54 2022] GET /compute/v2.1/servers/7fec36d5-04f6-46ec-8406-004966e4e97b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:08:59.351524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:59.352999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:59.359617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:59.360131 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:59.360864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:59.361560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:59.362022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:59.362459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:59.387252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d69ebb0a-8e55-4a91-ad4f-cfb36532a4b3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/ips" status: 200 len: 148 microversion: 2.1 time: 0.040680 Sep 08 14:08:59.387841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 419/831] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:08:59 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:00.859645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-80147748-abd4-4b6f-a2a9-f927acd6a006 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Action: 'create', calling method: .version_select at 0x7f7f8aed7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1012391161"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:01.034531 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abd4e832-215e-4285-951a-6b00eef08726"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:01.037423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:01.039874 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=34 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:01.045030 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.045514 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.045949 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:01.046641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.047099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.047515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:01.672955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-80147748-abd4-4b6f-a2a9-f927acd6a006 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.931307 Sep 08 14:09:01.673646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 413/832] 10.222.0.97 () {60 vars in 1155 bytes} [Thu Sep 8 14:09:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 933 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 14:09:01.687855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b35e86cb-b265-4b6f-ac7f-293727df7900 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8aeba550>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:01.743540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b35e86cb-b265-4b6f-ac7f-293727df7900 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 200 len: 345 microversion: 2.1 time: 0.059721 Sep 08 14:09:01.744236 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 414/833] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:09:01 2022] GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:09:02.142865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9a74e393-84ee-418b-85ef-68240480ce94 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "POST /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112216 Sep 08 14:09:02.143501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 420/834] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:09:01 2022] POST /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:09:02.759120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bcdf88df-a432-4874-a817-1cb7ae34ea0a tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8aeba670>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:02.806510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bcdf88df-a432-4874-a817-1cb7ae34ea0a tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 200 len: 346 microversion: 2.1 time: 0.052038 Sep 08 14:09:02.809044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 415/835] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:09:02 2022] GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:02.821573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f0cdbd3f-f5f3-4336-9ad2-13fdc9d6d80c tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Action: 'create', calling method: .version_select at 0x7f7f8ad63550>, body: {"snapshot": {"volume_id": "aef85a18-d32c-47f5-acc7-8920b2426ebd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1005705720"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:03.438786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f0cdbd3f-f5f3-4336-9ad2-13fdc9d6d80c tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.622465 Sep 08 14:09:03.439948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 421/836] 10.222.0.97 () {60 vars in 1162 bytes} [Thu Sep 8 14:09:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:03.456473 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c527e469-b47c-435a-9799-8ac2fbfb1095 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8aeef160>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:03.507940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c527e469-b47c-435a-9799-8ac2fbfb1095 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.055173 Sep 08 14:09:03.508717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 416/837] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:03 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:03.519824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e3011cf3-afac-493a-876f-46083579db18 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ae7bb80>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:03.554731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e3011cf3-afac-493a-876f-46083579db18 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038614 Sep 08 14:09:03.555431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 422/838] 10.222.0.97 () {58 vars in 1140 bytes} [Thu Sep 8 14:09:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:03.567151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2c59e882-cdf4-4474-bc17-98c573219b57 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8aed7b80>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:03.601786 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2c59e882-cdf4-4474-bc17-98c573219b57 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.038450 Sep 08 14:09:03.602537 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 417/839] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:03 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:04.616109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-328cfa2e-fa53-4ba2-8550-f50d44f8fb05 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad5b040>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:04.647253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-328cfa2e-fa53-4ba2-8550-f50d44f8fb05 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.036064 Sep 08 14:09:04.647860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 423/840] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:04 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:05.657565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:05.663333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4579f53e-a45a-4cb1-b780-8eab47ff9774 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8b028940>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:05.695996 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4579f53e-a45a-4cb1-b780-8eab47ff9774 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.039493 Sep 08 14:09:05.696623 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 418/841] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:05 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:06.709540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-adf20619-fb3b-4f85-a2a5-11f9464034ad tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad63f70>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:06.746233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-adf20619-fb3b-4f85-a2a5-11f9464034ad tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.036527 Sep 08 14:09:06.746233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 424/842] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:06 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:09:07.754487 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c5b8ef86-f461-49f8-b460-7f9d3c0f18a5 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8afefdc0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:07.786555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c5b8ef86-f461-49f8-b460-7f9d3c0f18a5 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 288 microversion: 2.1 time: 0.036342 Sep 08 14:09:07.787134 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 419/843] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:07 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:07.801044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c91a99be-84d3-4b2c-b3cf-b13615b6ad32 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad75820>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:07.941063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c91a99be-84d3-4b2c-b3cf-b13615b6ad32 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "DELETE /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 202 len: 0 microversion: 2.1 time: 0.146030 Sep 08 14:09:07.941621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 425/844] 10.222.0.97 () {58 vars in 1254 bytes} [Thu Sep 8 14:09:07 2022] DELETE /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:09:07.951427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9af167fa-003d-4541-9437-49cdfbf5f750 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8b0259d0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:07.984743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9af167fa-003d-4541-9437-49cdfbf5f750 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 200 len: 287 microversion: 2.1 time: 0.038089 Sep 08 14:09:07.985331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 420/845] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:07 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:08.999240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7573625-7864-419c-b4d4-e2c668390ac3 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad07940>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:09.025511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-f7573625-7864-419c-b4d4-e2c668390ac3 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] HTTP exception thrown: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7573625-7864-419c-b4d4-e2c668390ac3 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Request method failure captured: Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da HTTP/1.1 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfd80Szguu30FUVdo3cCytszcMzQBpjivZ0vcKUyur1jjtOCV2YA6Yk9H9VLKwmjoM_wHArUhiHOv9yk7dV8iOgffGn4XC04Smlccl1BQ_irYBoS5c5WaVXQrKBloNDm5V0r2Tu0IuR5j6Pdel3T02la_w4QhpdMmsHW-PCKPDhOiR8 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:09.029093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_053e4fab2bf84372bdaa118a9d6d8638", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 33fc47c3581b4211a83b9fff47789946 Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '27112dcb-15c4-4c6c-bbe4-9efacb9e13da'} Sep 08 14:09:09.030558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. (HTTP 404) (Request-ID: req-113de3da-4d2b-4df7-9dca-591644f8fe74) Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.031557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:09.033004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 14:09:09.034498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7573625-7864-419c-b4d4-e2c668390ac3 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Returning 404 to user: Snapshot 27112dcb-15c4-4c6c-bbe4-9efacb9e13da could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:09.037153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f7573625-7864-419c-b4d4-e2c668390ac3 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da" status: 404 len: 111 microversion: 2.1 time: 0.036000 Sep 08 14:09:09.038336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 426/846] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:08 2022] GET /compute/v2.1/os-snapshots/27112dcb-15c4-4c6c-bbe4-9efacb9e13da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:09.044028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fb1e90d4-a81a-4a42-9a47-d7f3101328ef tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8afef1f0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:09.311130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fb1e90d4-a81a-4a42-9a47-d7f3101328ef tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 202 len: 0 microversion: 2.1 time: 0.273434 Sep 08 14:09:09.311906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 421/847] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:09:09 2022] DELETE /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:09:09.325074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f0ae13dd-4a7d-45ea-882b-ae5f12a4cf7d tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad495e0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:09.375612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f0ae13dd-4a7d-45ea-882b-ae5f12a4cf7d tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 200 len: 345 microversion: 2.1 time: 0.055761 Sep 08 14:09:09.376338 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 427/848] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:09:09 2022] GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:10.058563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.059251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:10.066059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.066940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.066940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.067986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.067986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.069161 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.209141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'services' on Instance uuid f97a8f44-cc1a-4595-b736-7222ad2085fb {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:09:10.391503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c61dcece-aa2b-4ecc-8be1-733436b41b67 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad07c10>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.421398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-c61dcece-aa2b-4ecc-8be1-733436b41b67 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] HTTP exception thrown: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c61dcece-aa2b-4ecc-8be1-733436b41b67 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Request method failure captured: Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd HTTP/1.1 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfd80Szguu30FUVdo3cCytszcMzQBpjivZ0vcKUyur1jjtOCV2YA6Yk9H9VLKwmjoM_wHArUhiHOv9yk7dV8iOgffGn4XC04Smlccl1BQ_irYBoS5c5WaVXQrKBloNDm5V0r2Tu0IuR5j6Pdel3T02la_w4QhpdMmsHW-PCKPDhOiR8 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:10.423926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_053e4fab2bf84372bdaa118a9d6d8638", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 33fc47c3581b4211a83b9fff47789946 Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'aef85a18-d32c-47f5-acc7-8920b2426ebd'} Sep 08 14:09:10.426154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. (HTTP 404) (Request-ID: req-51175faf-e172-48f1-b04c-d23d6a5b0bc7) Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.427710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:10.429750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:09:10.431041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c61dcece-aa2b-4ecc-8be1-733436b41b67 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Returning 404 to user: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c61dcece-aa2b-4ecc-8be1-733436b41b67 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 404 len: 109 microversion: 2.1 time: 0.038752 Sep 08 14:09:10.432430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 428/849] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:09:10 2022] GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:10.448069 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b258e7ed-56aa-4a4d-8481-0c167a94dcb6 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad8df70>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-b258e7ed-56aa-4a4d-8481-0c167a94dcb6 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] HTTP exception thrown: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b258e7ed-56aa-4a4d-8481-0c167a94dcb6 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Request method failure captured: Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd HTTP/1.1 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfd80Szguu30FUVdo3cCytszcMzQBpjivZ0vcKUyur1jjtOCV2YA6Yk9H9VLKwmjoM_wHArUhiHOv9yk7dV8iOgffGn4XC04Smlccl1BQ_irYBoS5c5WaVXQrKBloNDm5V0r2Tu0IuR5j6Pdel3T02la_w4QhpdMmsHW-PCKPDhOiR8 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:10.496120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_053e4fab2bf84372bdaa118a9d6d8638", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 33fc47c3581b4211a83b9fff47789946 Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'aef85a18-d32c-47f5-acc7-8920b2426ebd'} Sep 08 14:09:10.498552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. (HTTP 404) (Request-ID: req-1cc7e02c-03ef-4967-861d-c344e4f9d589) Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.499952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:09:10.502272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:09:10.504390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b258e7ed-56aa-4a4d-8481-0c167a94dcb6 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Returning 404 to user: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b258e7ed-56aa-4a4d-8481-0c167a94dcb6 tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 404 len: 109 microversion: 2.1 time: 0.038045 Sep 08 14:09:10.506512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 429/850] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:09:10 2022] DELETE /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:09:10.508075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-344045b3-bb0e-4f32-adf9-6f55d90b937b tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Calling method '.version_select at 0x7f7f8ad079d0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.542903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-344045b3-bb0e-4f32-adf9-6f55d90b937b tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] HTTP exception thrown: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-344045b3-bb0e-4f32-adf9-6f55d90b937b tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Request method failure captured: Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd HTTP/1.1 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfd80Szguu30FUVdo3cCytszcMzQBpjivZ0vcKUyur1jjtOCV2YA6Yk9H9VLKwmjoM_wHArUhiHOv9yk7dV8iOgffGn4XC04Smlccl1BQ_irYBoS5c5WaVXQrKBloNDm5V0r2Tu0IuR5j6Pdel3T02la_w4QhpdMmsHW-PCKPDhOiR8 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:10.544900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/053e4fab2bf84372bdaa118a9d6d8638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_053e4fab2bf84372bdaa118a9d6d8638", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 053e4fab2bf84372bdaa118a9d6d8638 Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1099848336 Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 33fc47c3581b4211a83b9fff47789946 Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1099848336-project Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'aef85a18-d32c-47f5-acc7-8920b2426ebd'} Sep 08 14:09:10.546480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. (HTTP 404) (Request-ID: req-ce2cb168-4cf5-44c2-8557-9537c116f046) Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.547706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:09:10.549152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:09:10.550707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-344045b3-bb0e-4f32-adf9-6f55d90b937b tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] Returning 404 to user: Volume aef85a18-d32c-47f5-acc7-8920b2426ebd could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-344045b3-bb0e-4f32-adf9-6f55d90b937b tempest-VolumesSnapshotsTestJSON-1099848336 tempest-VolumesSnapshotsTestJSON-1099848336-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd" status: 404 len: 109 microversion: 2.1 time: 0.046883 Sep 08 14:09:10.552053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 430/851] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:09:10 2022] GET /compute/v2.1/os-volumes/aef85a18-d32c-47f5-acc7-8920b2426ebd => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:09:10.573597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bae8a11e-095a-4386-878b-9968506be404 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments/abd4e832-215e-4285-951a-6b00eef08726" status: 202 len: 0 microversion: 2.1 time: 0.519432 Sep 08 14:09:10.578471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 422/852] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:09:10 2022] DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments/abd4e832-215e-4285-951a-6b00eef08726 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:09:10.589102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.592000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:10.607699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.608781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.609815 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.611305 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.612245 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.613151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.622784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:10.673324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-52b0a4e5-9de0-451e-81bc-160c28e77960 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089355 Sep 08 14:09:10.673859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 431/853] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:09:10 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:11.687387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:11.689930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:11.696894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:11.697400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:11.697851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:11.698573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:11.699042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:11.699478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:11.739579 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-29db5141-711e-4252-9374-ef090944d477 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057140 Sep 08 14:09:11.740197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 423/854] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:09:11 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:12.754533 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:12.757591 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:12.765086 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.765497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.765938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.766791 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.767102 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.767538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.799263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-11be22a6-ea97-40c5-ae83-1a06c600bcfc tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049977 Sep 08 14:09:12.799847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 432/855] 10.222.0.97 () {58 vars in 1302 bytes} [Thu Sep 8 14:09:12 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:09:12.866109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:12.866899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:12.876168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.876664 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.877099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.878076 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.879092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.879539 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.908311 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:09:13.320195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ced4d458-0dd3-4767-83f7-1e4438e7c13e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 204 len: 0 microversion: 2.1 time: 0.458366 Sep 08 14:09:13.321212 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 424/856] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:12 2022] DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:09:13.333757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:13.335156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:13.345532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.346573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.347851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.348975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.349678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.350348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.496648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:13.505182 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-226250d3-e70f-484d-9247-034cc8e7951c tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1679 microversion: 2.1 time: 0.178091 Sep 08 14:09:13.505818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 433/857] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:13 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:14.531790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:14.531790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:14.538865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:14.539369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:14.539816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:14.540602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:14.541102 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:14.541694 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:14.690822 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:14.699380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b7da3dfd-277d-4008-8e79-bb17295b7952 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1679 microversion: 2.1 time: 0.173770 Sep 08 14:09:14.699967 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 425/858] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:14 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:15.724570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:15.725332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:15.732830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.733326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.733767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.734477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.734943 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.735381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.875819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:15.885565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f8d39805-facc-4762-b944-b200eeaaeff3 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1679 microversion: 2.1 time: 0.165431 Sep 08 14:09:15.886140 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 434/859] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:15 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:16.194974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a8f44-cc1a-4595-b736-7222ad2085fb", "name": "network-vif-deleted", "tag": "429d2f2c-ab68-486a-aeae-d65181cdc543"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:16.206452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.206452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.207944 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:16.221575 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] Creating event network-vif-deleted:429d2f2c-ab68-486a-aeae-d65181cdc543 for instance f97a8f44-cc1a-4595-b736-7222ad2085fb on hv-cinder-85646 Sep 08 14:09:16.227696 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-9d17e3df-54b8-461a-b6c1-c426b8014f72 req-0c8a59f3-bc1e-4cb2-a812-c57ad9f6bdc8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036888 Sep 08 14:09:16.229549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 426/860] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:16.912374 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:16.913736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:16.920816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.921568 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.922799 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:16.923149 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.923598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.924230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:16.961159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:16.961578 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:16.962009 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:16.962457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lazy-loading 'fault' on Instance uuid f97a8f44-cc1a-4595-b736-7222ad2085fb {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:09:17.009512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0569d9de724d5fbe3f41cbc0687d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a3e908b87b445b9674d48f9a61bf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:17.017842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fd6ec292-cd73-4598-ae7e-f13505620a6e tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 200 len: 1331 microversion: 2.1 time: 0.111551 Sep 08 14:09:17.018429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 435/861] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:16 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:18.043768 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:18.044591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:18.051875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:18.052401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:18.052843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:18.053548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:18.054009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:18.054495 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:18.071350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb HTTP/1.1 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:18.073105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:18.074646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'f97a8f44-cc1a-4595-b736-7222ad2085fb'} Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:18.075511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:18.077062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:18.078367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:18.078367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2d4a34f0-1c54-49f7-9dd2-94ff76b8d0f5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 404 len: 111 microversion: 2.1 time: 0.035163 Sep 08 14:09:18.078367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 427/862] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:18 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:18.083787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dd8de2ae-4067-45e2-a307-79d651755539 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '.version_select at 0x7f7f8ad9fa60>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:18.178551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dd8de2ae-4067-45e2-a307-79d651755539 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188053547" status: 202 len: 0 microversion: 2.1 time: 0.098594 Sep 08 14:09:18.179171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 436/863] 10.222.0.97 () {58 vars in 1221 bytes} [Thu Sep 8 14:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188053547 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:09:22.833698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:22.834281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:22.840958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.841452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.841890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.842597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.843053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.843471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.859557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb HTTP/1.1 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:22.861158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.862818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'f97a8f44-cc1a-4595-b736-7222ad2085fb'} Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:22.863743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.865222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.866695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:22.866695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-60a518de-e954-4d0b-8c03-b909d270a5ca tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 404 len: 111 microversion: 2.1 time: 0.033447 Sep 08 14:09:22.866695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 428/864] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:22 2022] DELETE /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:22.872194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:22.872906 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: f97a8f44-cc1a-4595-b736-7222ad2085fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:22.880384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.880875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.881309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.882012 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:22.882469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:22.882891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:22.900455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb HTTP/1.1 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:22.906655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.908249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f97a8f44-cc1a-4595-b736-7222ad2085fb'} Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:22.909142 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. Sep 08 14:09:22.910613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:22.912114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance f97a8f44-cc1a-4595-b736-7222ad2085fb could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:22.912114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1dadabcc-28b9-4e0c-8194-cee0dbed6071 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb" status: 404 len: 111 microversion: 2.1 time: 0.035975 Sep 08 14:09:22.912114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 437/865] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:22 2022] GET /compute/v2.1/servers/f97a8f44-cc1a-4595-b736-7222ad2085fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:24.329232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:24.329970 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:24.337327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.337827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.338262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.338968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.339592 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.340078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.369401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-87734d3b-bf6c-474f-9e2d-64cbde02ab2b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/ips" status: 200 len: 150 microversion: 2.20 time: 0.043930 Sep 08 14:09:24.376226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 429/866] 10.222.0.97 () {60 vars in 1289 bytes} [Thu Sep 8 14:09:24 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:09:24.403852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:24.404792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:24.416701 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.417542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.418315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.419183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.419691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.420241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.443492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb HTTP/1.1 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:24.448312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.449866 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '30c94983-e106-4369-9254-a41da0e031fb'} Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:24.450750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.452223 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.453675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:24.453675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5ca890ae-8c25-4bb2-9f0a-b98ae74c6217 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 404 len: 111 microversion: 2.1 time: 0.048035 Sep 08 14:09:24.453675 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 438/867] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:24 2022] DELETE /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:24.459037 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:24.459707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 30c94983-e106-4369-9254-a41da0e031fb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:24.465956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.466448 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.466906 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.467640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.468108 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.468567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.483092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb HTTP/1.1 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:24.484920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.486466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '30c94983-e106-4369-9254-a41da0e031fb'} Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:24.487276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. Sep 08 14:09:24.488540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.489738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 30c94983-e106-4369-9254-a41da0e031fb could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:24.489738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-27f0e11a-a80d-4e29-8d5d-435fc6f616b5 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb" status: 404 len: 111 microversion: 2.1 time: 0.032723 Sep 08 14:09:24.489738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 430/868] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:24 2022] GET /compute/v2.1/servers/30c94983-e106-4369-9254-a41da0e031fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:24.495700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:24.496028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:24.503292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.503801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.504276 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.504998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.505464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.505897 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.522921 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb HTTP/1.1 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:24.524764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.526398 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '57436947-9181-4656-8f1a-651b365e68bb'} Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:24.527266 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.528528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.529757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:24.530712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e9cf2f7e-137e-4153-a3dd-f66896b18258 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 404 len: 111 microversion: 2.1 time: 0.039171 Sep 08 14:09:24.531556 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 439/869] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:24 2022] DELETE /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:24.539932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:24.540576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 57436947-9181-4656-8f1a-651b365e68bb] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:24.547716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.549139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.549139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.549859 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:24.550326 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:24.550774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:24.566762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb HTTP/1.1 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:24.568445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.570329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '57436947-9181-4656-8f1a-651b365e68bb'} Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:24.571125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. Sep 08 14:09:24.572355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:24.574456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 57436947-9181-4656-8f1a-651b365e68bb could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:24.574456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cc32fdf7-bcd3-4d36-9e12-696af905c1a8 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb" status: 404 len: 111 microversion: 2.1 time: 0.034047 Sep 08 14:09:24.574456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 431/870] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:24 2022] GET /compute/v2.1/servers/57436947-9181-4656-8f1a-651b365e68bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:25.937399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:25.937938 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:25.945526 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:25.946028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:25.946466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:25.947214 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:25.947679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:25.948108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:25.963319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 HTTP/1.1 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:09:25.964952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:25.966611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '8ff597ca-3f06-47d9-92c0-b3fc4522c030'} Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:25.967679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:25.976261 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:09:25.977786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:25.977786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e4a7c835-e6ab-4663-b877-f55a32f19122 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 404 len: 111 microversion: 2.1 time: 0.032908 Sep 08 14:09:25.977786 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 440/871] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:25 2022] DELETE /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:25.978040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:25.978040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] [instance: 8ff597ca-3f06-47d9-92c0-b3fc4522c030] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:25.983283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:25.983780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:25.984257 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:25.984969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:25.985433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:25.985862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:26.000089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] HTTP exception thrown: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Request method failure captured: Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 HTTP/1.1 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfXUqd5sPftckH6NTOYpKV3Hn9lG3tFmuicLOEXaLOCIVBVdxkHronOUGbp16OZteDeGHFgPPuLiKkHJNfQlriNWp9kyy2YTaUYzZ9eyaypEyoqu3hW7Uj6DdOhtHkv2MZUUeXkmhdXo9GSoIGPaRL7N5dgcXBhJlLxraUDyQp5Dkm8 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:26.001709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/92a3e908b87b445b9674d48f9a61bf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_92a3e908b87b445b9674d48f9a61bf94", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 92a3e908b87b445b9674d48f9a61bf94 Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1708118027 Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 9b0569d9de724d5fbe3f41cbc0687d75 Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeNegativeTest-1708118027-project Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:26.003618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '8ff597ca-3f06-47d9-92c0-b3fc4522c030'} Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:26.004497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. Sep 08 14:09:26.005756 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:26.006856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] Returning 404 to user: Instance 8ff597ca-3f06-47d9-92c0-b3fc4522c030 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:26.006856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-84098240-849f-4076-88a7-8a673a7d6ff7 tempest-AttachVolumeNegativeTest-1708118027 tempest-AttachVolumeNegativeTest-1708118027-project] 10.222.0.97 "GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030" status: 404 len: 111 microversion: 2.1 time: 0.032717 Sep 08 14:09:26.006856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 432/872] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:25 2022] GET /compute/v2.1/servers/8ff597ca-3f06-47d9-92c0-b3fc4522c030 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:09:26.813233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:26.813796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:26.820645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:26.821132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:26.821569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:26.822275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:26.822729 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:26.823154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:26.850153 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lazy-loading 'flavor' on Instance uuid f4b5a76e-6957-466c-bf07-13e01fd80403 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:09:27.490105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bb5d31a3-a1f2-4d88-9862-f9e5601694cb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/action" status: 202 len: 0 microversion: 2.20 time: 0.680523 Sep 08 14:09:27.494516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 441/873] 10.222.0.97 () {62 vars in 1319 bytes} [Thu Sep 8 14:09:26 2022] POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:09:27.499917 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:27.501246 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:27.508623 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:27.509478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:27.510132 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:27.511088 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:27.511922 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:27.512661 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:27.755016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:27.763951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:27.765465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:27.766779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e51fad6a-b41b-4e1b-92ed-cd5f2f418124 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.271323 Sep 08 14:09:27.767363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 433/874] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:27 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:28.795234 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:28.796036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:28.804960 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:28.805573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:28.806067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:28.806851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:28.807334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:28.807754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:29.067366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:29.082991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:29.085964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:29.088256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2d7964c2-2d6d-4b92-a640-67e7288ae9d6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.298567 Sep 08 14:09:29.089273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 442/875] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:28 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:30.127585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:30.129255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:30.167062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:30.168135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:30.168806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:30.169801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:30.170719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:30.171358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:30.379052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:30.395559 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:30.398258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:30.400647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3fd2faeb-25f1-4efb-ac9e-b2b5044ff4ce tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.276958 Sep 08 14:09:30.401725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 434/876] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:30 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:31.427614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:31.428447 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:31.432169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:31.435829 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:31.436607 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:31.437162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:31.437860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:31.438312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:31.438731 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:31.593322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:31.601822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:31.603271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:31.604491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-618f2c6a-76d1-4cd9-9e53-448787691178 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.181401 Sep 08 14:09:31.605206 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 443/877] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:31 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:32.631576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:32.632658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:32.635435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.640628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:32.641114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:32.641602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:32.642376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:32.642767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:32.643194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:32.790266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:32.799124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:32.801130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:32.802288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-530e956d-aa4a-4074-bf5c-0d7077266564 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.175190 Sep 08 14:09:32.802856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 435/878] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:32 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:33.828173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:33.828909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:33.837253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:33.837740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:33.838272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:33.838969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:33.839430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:33.839899 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:33.979891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:33.988880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:33.990308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:33.991466 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aabb0eb5-5290-499f-b75f-af03caaae2c0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.167291 Sep 08 14:09:33.992020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 444/879] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:33 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:35.017745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:35.018934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:35.025626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:35.026104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:35.026605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:35.027669 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:35.028164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:35.028591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:35.171317 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:35.180263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:35.181709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:35.182886 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1d2e99e5-92f9-47cd-b0c7-06dd25c0f2f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.169174 Sep 08 14:09:35.183451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 436/880] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:35 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:36.209154 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:36.210044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:36.216408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:36.216893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:36.217327 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:36.218026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:36.218479 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:36.218902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:36.353929 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:36.362189 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:36.363642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:36.364864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3f524ca6-9949-472b-8893-984c86781f70 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.160344 Sep 08 14:09:36.365431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 445/881] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:36 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:09:37.392417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:37.393662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:37.399884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:37.400402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:37.400843 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:37.401536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:37.402002 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:37.402428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:37.537630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:37.546006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:37.547373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:37.548579 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ec3933ae-314d-4602-9b86-6da73cae38c5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.160201 Sep 08 14:09:37.549952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 437/882] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:37 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:38.574054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:38.576124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:38.581827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:38.582304 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:38.582740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:38.583459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:38.583947 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:38.584403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:38.867987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:38.876389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:38.878537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:38.879748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9e313020-fa7e-4850-b6c5-8d661310dd0e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.309682 Sep 08 14:09:38.880344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 446/883] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:38 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:39.905288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:39.905993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:39.913223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:39.913940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:39.914555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:39.915257 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:39.915716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:39.916165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:39.920708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:40.054365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:40.062660 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:40.064099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:40.065285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-290999fe-4389-4ac2-93c6-6edb08fc775f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.164099 Sep 08 14:09:40.065856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 438/884] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:39 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:41.091354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:41.091979 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:41.098515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:41.098997 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:41.099430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:41.100111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:41.100600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:41.101049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:41.233845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:41.241955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:41.243379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:41.244569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cc1f391d-0df3-4f3d-b1f6-3b602ce4255c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.157188 Sep 08 14:09:41.245126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 447/885] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:41 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:42.271641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:42.272573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:42.284123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:42.284123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:42.284123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:42.284123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:42.284580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:42.284580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:42.415523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:42.424618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:42.426087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:42.427296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cb521a2c-f1a3-480c-8a32-dcf7cfedc4a9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.161266 Sep 08 14:09:42.427851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 439/886] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:42 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:43.453315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:43.454017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:43.461342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:43.461760 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:43.462230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:43.462994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:43.463579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:43.463889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:43.602239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:43.613329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:43.615057 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:43.616615 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-17c6e60d-b57d-48e8-aa0c-b20debdbedaf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.167042 Sep 08 14:09:43.617309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 448/887] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:43 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:44.644060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:44.644617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:44.651145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:44.651686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:44.652078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:44.652813 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:44.653280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:44.653711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:44.788103 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:44.796377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:44.797812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:44.799685 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8b86d925-a9f8-4bf6-8f6d-b636e8110259 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.159019 Sep 08 14:09:44.800267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 440/888] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:44 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:45.824840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:45.825455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:45.833203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:45.833695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:45.834170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:45.834875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:45.835371 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:45.835805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:45.838598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:45.977013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:45.986249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:45.987795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:45.989015 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8e9ced77-69fa-4a0a-849c-e19224cf6de5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.168185 Sep 08 14:09:45.989569 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 449/889] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:45 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:47.014910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:47.015589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:47.022159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.026771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.026771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.026771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.026771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.027168 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.128622 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:47.129999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:47.136698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.137177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.137613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.138535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.139175 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.139600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.166953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:47.168700 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:09:47.177053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:47.178502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:47.179677 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d25f88a2-d202-4a0a-a074-5e45a99aa7a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.168671 Sep 08 14:09:47.180279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 441/890] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:47 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:47.198680 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:47.207816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.208421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.208782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.221427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] Creating event network-changed:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:09:47.232811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-983f6f6c-4529-451a-ae06-cc0d3fbb41da req-7b4a51ba-244c-4109-8d69-41584032bf20 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037897 Sep 08 14:09:47.232811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 442/891] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:47.589159 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-72946be1-9977-40c8-a3ae-c1722dffa92f tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 204 len: 0 microversion: 2.1 time: 0.464805 Sep 08 14:09:47.591631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 450/892] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:09:47 2022] DELETE /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:09:47.599933 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:47.600697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:47.608027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.608900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.613099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.614196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.614937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.615552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.790760 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:47.801154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-655ff7b6-d7de-4536-bc56-7bae9398fc79 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.205835 Sep 08 14:09:47.806388 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 443/893] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:47 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:48.206255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:48.207075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:48.213964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.214531 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.230401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.230401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.230401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.230401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.357557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:48.365898 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:48.367351 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:48.368557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0f098404-b15d-4ec8-90ea-3942b8c21c13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.167299 Sep 08 14:09:48.369115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 451/894] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:48 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:48.825577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:48.826186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:48.833496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.833984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.834426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.835126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.835588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.836013 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.993266 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:49.002062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a0476ffb-f22f-4146-801a-074bda333c6c tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.179716 Sep 08 14:09:49.002694 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 444/895] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:48 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:49.394313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:49.394863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:49.401609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:49.402078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:49.402508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:49.403292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:49.403886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:49.404343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:49.543195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:49.552339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:49.553801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:49.554998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-86959da9-6ce7-4ac4-a079-c9883771ec97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.164816 Sep 08 14:09:49.568259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 452/896] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:49 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:50.026024 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:50.026722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:50.033180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.033667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.034104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.034804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.035281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.035765 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.168049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:50.176498 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5259356f-c749-440e-bfc5-f711d3fe7424 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.154349 Sep 08 14:09:50.177081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 445/897] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:50 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:50.585739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:50.586408 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:50.593492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.594127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.594573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.595835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.596312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.596750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.738648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:50.746803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:50.748279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:50.749994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dd2a6a04-e310-409d-ac0f-b44470a1c069 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1744 microversion: 2.20 time: 0.168033 Sep 08 14:09:50.751044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 453/898] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:50 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:51.202384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:51.205309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:51.211841 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:51.212595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:51.213151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:51.214989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:51.216118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:51.217778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:51.373278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:51.382151 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c6d8525c-e44e-4c4e-8796-14b9d42055f5 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1568 microversion: 2.1 time: 0.185574 Sep 08 14:09:51.382841 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 446/899] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:51 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:51.775950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:51.776766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:51.784268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:51.784753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:51.786631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:51.788634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:51.789461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:51.792597 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:51.957042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:51.967695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:51.970275 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:51.972982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0af0c632-5070-4a91-8042-42c6d9c071cc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.200362 Sep 08 14:09:51.976242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 454/900] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:51 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:52.296276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c297e02-238c-4210-9932-aece5d5a3529", "name": "network-vif-deleted", "tag": "1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:52.322064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:52.322545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:52.323371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:52.347210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] Creating event network-vif-deleted:1fe34b97-ee0d-4b37-a71a-6f3cc13bc1a8 for instance 7c297e02-238c-4210-9932-aece5d5a3529 on hv-cinder-85646 Sep 08 14:09:52.355770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-83d35df0-4b3d-4f75-b197-717ef3403943 req-1fe59661-1855-4731-a0d8-36a24ec88d26 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069390 Sep 08 14:09:52.356776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 447/901] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:52.406054 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:52.406676 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:52.414740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:52.415242 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:52.415679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:52.420076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:52.420655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:52.426699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:52.505769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:52.514867 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fcf74473-8c4d-40e0-8d60-88b405862431 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1381 microversion: 2.1 time: 0.112630 Sep 08 14:09:52.515810 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 455/902] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:52 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1381 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:52.988681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "name": "network-vif-plugged", "status": "completed", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:52.999423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:53.000692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:53.003616 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.004157 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.017870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.018071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.018071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.018071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.018071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.018372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.018372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.019580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] Creating event network-vif-plugged:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:09:53.025290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-9d0099fb-097f-4886-b84a-55cdaca5d873 req-a3eba8aa-cbdb-44e9-a857-514f7cc1a270 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047667 Sep 08 14:09:53.025935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 448/903] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:53.228640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:53.237816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:53.240186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:53.241449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2c176e66-b506-40e6-9e02-ab7901bd8def tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.246473 Sep 08 14:09:53.250095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 456/904] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:52 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:09:53.543545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:53.545028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:53.556263 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.557420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.557881 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.558736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.559278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.559885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.612331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.613237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.614016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.614759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lazy-loading 'fault' on Instance uuid 7c297e02-238c-4210-9932-aece5d5a3529 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:09:53.680855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1729bb4d783f425085185c344dfe2ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe528c21e8c94eb6af8d5f86757328b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:53.692717 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4fd80195-7fd3-46a0-a31e-eca6f5d7df01 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 200 len: 1224 microversion: 2.1 time: 0.153735 Sep 08 14:09:53.696652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 449/905] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:53 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 1224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:54.271521 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:54.272805 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:54.280192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.280964 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.281630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.282552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.283948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.289006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.458181 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:54.479659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:54.481164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:54.482493 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8f577493-8f29-4017-bb43-fe961a520a81 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.216372 Sep 08 14:09:54.483419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 457/906] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:54 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:54.733644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:54.734401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] [instance: 7c297e02-238c-4210-9932-aece5d5a3529] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:54.750440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.750979 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.752127 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.754043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.754957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.755480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.773213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] HTTP exception thrown: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Request method failure captured: Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 HTTP/1.1 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfZXSuDW26p6xJGbCLfy3rUc4C-htjUIONrdv3OJmrRJLTJCt6NsIiMVa-tmDTjP1geVgcTf1yVVq5vw6_ey_BtNsmcgh4oHXo1JL8ZKEE2hQQHl8mJzRlKQxpwG5p4o2T4Eu8bbqOlRFMBa65Zn3yBB2LUteTmzOFPxzOOIjvo39pI Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: fe528c21e8c94eb6af8d5f86757328b8 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-TestShelveInstance-1909576763 Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:09:54.775165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/fe528c21e8c94eb6af8d5f86757328b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/fe528c21e8c94eb6af8d5f86757328b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/fe528c21e8c94eb6af8d5f86757328b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_fe528c21e8c94eb6af8d5f86757328b8", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-TestShelveInstance-1909576763 Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: fe528c21e8c94eb6af8d5f86757328b8 Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-TestShelveInstance-1909576763 Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-TestShelveInstance-1909576763-project Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 1729bb4d783f425085185c344dfe2ab8 Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-TestShelveInstance-1909576763-project Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. Sep 08 14:09:54.781538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '7c297e02-238c-4210-9932-aece5d5a3529'} Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:09:54.789229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. Sep 08 14:09:54.792460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:09:54.794982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Returning 404 to user: Instance 7c297e02-238c-4210-9932-aece5d5a3529 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:09:54.794982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d04a40b9-2812-4e34-94a1-5371d63d5629 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529" status: 404 len: 111 microversion: 2.1 time: 0.049158 Sep 08 14:09:54.794982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 450/907] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:54 2022] GET /compute/v2.1/servers/7c297e02-238c-4210-9932-aece5d5a3529 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:09:55.257547 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-19434347-cd3a-435f-8246-2fd1559db2c0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] Calling method '.version_select at 0x7f7f8aef1af0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:55.453397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-19434347-cd3a-435f-8246-2fd1559db2c0 tempest-TestShelveInstance-1909576763 tempest-TestShelveInstance-1909576763-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-125580282" status: 202 len: 0 microversion: 2.1 time: 0.199679 Sep 08 14:09:55.454078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 458/908] 10.222.0.97 () {58 vars in 1251 bytes} [Thu Sep 8 14:09:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-125580282 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:09:55.513913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:55.514565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:55.521301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:55.521873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:55.522319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:55.523053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:55.523510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:55.523937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:55.674856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:55.684050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:55.685584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:55.686755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e73cd5ee-b09b-4167-81fa-f6864c57afcc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.177083 Sep 08 14:09:55.688192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 451/909] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:55 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:56.718612 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:56.719203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:56.739202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:56.740529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:56.741902 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:56.744360 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:56.745250 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:56.745969 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:56.959679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:56.970694 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:56.972970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:56.974666 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-07a4fdd6-d329-4786-846a-2be53940a8b6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.264077 Sep 08 14:09:56.989525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 459/910] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:56 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:09:58.003741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:58.004427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:58.026129 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:58.026676 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:58.027149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:58.027880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:58.028365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:58.028794 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:58.183624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:58.194072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:58.205459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:58.205459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3d86dd4b-7625-41e3-a1bc-85703d96cf1a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.198323 Sep 08 14:09:58.205459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 452/911] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:57 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:09:59.243707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:59.244869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:59.292314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.297584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.299029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.304133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.304973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.308772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.604039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:59.615750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:59.618103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:59.619706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-31a4a989-3750-4223-bf44-383cf5bc7fa4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.394867 Sep 08 14:09:59.628331 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 460/912] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:09:59 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:00.658748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:00.660725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:00.674343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:00.674849 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:00.675308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:00.678342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:00.678845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:00.679292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:01.256757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:01.267544 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:01.267673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:01.268824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5979dbba-2ef7-42ac-8b75-2107e87578e3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.614927 Sep 08 14:10:01.271988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 453/913] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:00 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:02.299792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:02.301263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:02.308630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.309387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.310057 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.310838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.311548 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.312046 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.514472 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:02.527748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:02.529834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:02.531263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9ad1174c-bf10-4afa-a79c-b36f09c06049 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.236072 Sep 08 14:10:02.531837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 461/914] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:02 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:03.560061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:03.560971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:03.607400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=40 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:03.607400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.607400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.607400 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.608006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.608006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.608006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.833750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:03.848908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:03.855608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:03.860933 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d23ab639-df0e-4c2c-aada-98b963f2a6bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.303858 Sep 08 14:10:03.879474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 454/915] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:03 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:04.894771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:04.896053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:04.902603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:04.910551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:04.911049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:04.911485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:04.912529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:04.912718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:04.913150 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.054424 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:05.062483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:05.064431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:05.065584 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7a89a6f2-27a7-4a17-b1fc-5948dbd119bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.176149 Sep 08 14:10:05.066138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 462/916] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:04 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:06.094825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:06.096331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:06.105536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.106353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.106974 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.108061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.108782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.109300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.263845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:06.273348 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:06.274789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:06.275952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2abaf614-96d8-4b84-b8e1-1c7083827417 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.186925 Sep 08 14:10:06.276576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 455/917] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:06 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:07.315193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:07.317324 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:07.340413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:07.341107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:07.341624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:07.342511 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:07.343091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:07.343657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:07.511775 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:07.521095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:07.522658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:07.523834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a5da634d-3a1a-4718-a207-2391e20905d4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.223223 Sep 08 14:10:07.524440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 463/918] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:07 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:08.551965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:08.552766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:08.560850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:08.561344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:08.562026 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:08.563116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:08.564426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:08.565596 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:08.725393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:08.735135 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:08.736657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:08.737973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ed913e1a-3d04-4bb9-a3ed-db22283acaed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1739 microversion: 2.20 time: 0.190552 Sep 08 14:10:08.738551 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 456/919] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:08 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:09.765267 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:09.765905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:09.772714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:09.773201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:09.773643 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:09.774377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:09.774836 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:09.775294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:09.921111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:09.930861 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:09.932737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:09.934379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-302764c2-2b62-4d88-95f1-4ef380e90909 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1721 microversion: 2.20 time: 0.173124 Sep 08 14:10:09.935006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 464/920] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:09 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:10.961840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:10.962515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:10.969123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:10.973816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:10.973816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:10.973816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:10.973816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:10.974145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:10.974294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:11.105556 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:11.114289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:11.115729 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:11.116982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c1e92f93-27ce-4308-9299-367770b840a6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1721 microversion: 2.20 time: 0.159188 Sep 08 14:10:11.117557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 457/921] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:10 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:11.833083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "name": "network-vif-unplugged", "status": "completed", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:11.844105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:11.844945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:11.845383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:11.849520 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:11.860611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] Creating event network-vif-unplugged:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:10:11.866416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-8d201f67-50c7-44ac-b753-b1c130b21ef7 req-89a9c854-44f8-4cc3-965b-09cbfd1d8b06 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039811 Sep 08 14:10:11.867111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 465/922] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:12.147082 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:12.147812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:12.154884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:12.155503 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:12.155986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:12.156866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:12.157980 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:12.158423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:12.319576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:12.328036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:12.330235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:12.331564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3e5752ca-f73a-46b9-aa24-894bb9f2a835 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1721 microversion: 2.20 time: 0.189313 Sep 08 14:10:12.333209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 458/923] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:12 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:13.360091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:13.360814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:13.367476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:13.367963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:13.368419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:13.369124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:13.369579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:13.370008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:13.512642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:13.521443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:13.522885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:13.524067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-669424f1-33fb-4366-b51b-02cad16ffced tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1721 microversion: 2.20 time: 0.169122 Sep 08 14:10:13.524666 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 466/924] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:13 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:10:14.551787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:14.552460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:14.559063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:14.559552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:14.559992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:14.560731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:14.561192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:14.561624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:14.702949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:14.715052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:14.716523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:14.717690 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c113328a-7cb6-440d-8d4d-4b234591a10e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1724 microversion: 2.20 time: 0.170678 Sep 08 14:10:14.718279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 459/925] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:14 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:14.745620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe430b01-19cd-48cd-960f-4ecbff9c927f"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:14.747946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:14.755519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:14.756003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:14.756471 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:14.757188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:14.757648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:14.758079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:16.088330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-483be2fb-9bfe-4d53-889e-791315782306 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.346403 Sep 08 14:10:16.089055 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 467/926] 10.222.0.97 () {62 vars in 1364 bytes} [Thu Sep 8 14:10:14 2022] POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments => generated 188 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:10:16.241088 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:16.241935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:16.248290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:16.248809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:16.249257 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:16.249985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:16.251069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:16.251651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:16.288474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128401) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:10:16.680601 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0bfda345-6ac3-44d4-8937-1499157d6ea4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/action" status: 202 len: 0 microversion: 2.20 time: 0.447502 Sep 08 14:10:16.682012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 460/927] 10.222.0.97 () {62 vars in 1319 bytes} [Thu Sep 8 14:10:16 2022] POST /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:16.691855 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:16.694131 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:16.700060 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:16.700592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:16.701245 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:16.701957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:16.702419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:16.702846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:16.854211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:16.863289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:16.865109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:16.866372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f93ebb25-fbb8-462e-b3b7-15d75fcf7c97 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1810 microversion: 2.20 time: 0.179950 Sep 08 14:10:16.866950 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 468/928] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:16 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:10:17.894775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:17.895392 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:17.902866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:17.903471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:17.903795 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:17.904550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:17.905018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:17.905444 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:18.065667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:18.074857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:18.076769 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:18.078037 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ccec169f-0649-4985-a8dc-fa3dd86e64ca tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1750 microversion: 2.20 time: 0.187930 Sep 08 14:10:18.079197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 461/929] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:17 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:19.114188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:19.115487 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:19.122963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.123452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.123893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.124677 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:19.125132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:19.125564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:19.282460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:19.291452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:19.292920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:19.294160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-600efa15-30c7-4a4a-b5ed-d2840822da0c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1752 microversion: 2.20 time: 0.184842 Sep 08 14:10:19.295134 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 469/930] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:19 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:20.323186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:20.324593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:20.333021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:20.333858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:20.334253 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:20.334962 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:20.335423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:20.335870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:20.493144 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:20.502597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:20.504019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:20.505218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f167050b-0bab-4589-b07f-af9f1dd685ad tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1752 microversion: 2.20 time: 0.186684 Sep 08 14:10:20.505869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 462/931] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:20 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:20.648741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1288261670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-23972180", "security_groups": [{"name": "tempest-secgroup-smoke-2101580619"}], "block_device_mapping_v2": [{"uuid": "40d4b543-69d3-4b90-9833-56463c357bcf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1825ab58-9a7f-4a28-9e67-c083bb9f8e93"}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:20.772634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] validate_networks() for [('1825ab58-9a7f-4a28-9e67-c083bb9f8e93', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:10:21.189473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:10:21.190303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:10:21.191455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:10:21.192092 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:10:21.192542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:10:21.208575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.208575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.209039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.209567 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.210038 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.211196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.231008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:10:21.236557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Getting quotas for user 26aa79753d6e4e49ad66cc32ba786fe8 and project ae31829bffd7483fbab3dc87635aea58. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:10:21.305602 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:10:21.307763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d4b543-69d3-4b90-9833-56463c357bcf',volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:10:21.533762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:21.538959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:21.541398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.541887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.542364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.543098 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:21.543560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:21.543990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:21.715938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:21.726762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:21.728507 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:21.729920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ee1f0e62-faa7-4f81-b42e-0dacf4ea3dc5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.202108 Sep 08 14:10:21.745380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 463/932] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:21 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:10:21.972516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-869ef7da-3e49-49b3-9b48-a7c0667dda6c tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.327738 Sep 08 14:10:21.973903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 470/933] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:10:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:10:21.985779 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ea3ba77f-0313-4d3f-b026-118be3e65a8a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:21.986395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ea3ba77f-0313-4d3f-b026-118be3e65a8a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:22.057454 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ea3ba77f-0313-4d3f-b026-118be3e65a8a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.069642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ea3ba77f-0313-4d3f-b026-118be3e65a8a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1093 microversion: 2.1 time: 0.088006 Sep 08 14:10:22.070199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 464/934] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:21 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:22.772265 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:22.772892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:22.785500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.786413 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.787190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.788505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:22.789309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:22.790060 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:22.947761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.957810 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.959260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:22.960503 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-62196a19-3313-4491-8410-56b401a217a2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.192784 Sep 08 14:10:22.961073 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 471/935] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:22 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:23.093873 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-afe52739-97ec-4aae-a744-9ea4836ebab1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:23.106552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-afe52739-97ec-4aae-a744-9ea4836ebab1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:23.162365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-afe52739-97ec-4aae-a744-9ea4836ebab1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:23.170167 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-afe52739-97ec-4aae-a744-9ea4836ebab1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1093 microversion: 2.1 time: 0.080114 Sep 08 14:10:23.170763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 465/936] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:23 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:23.990834 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:23.991704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:24.004115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.005310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.007936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.012628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.013163 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.013836 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.195062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:24.195682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:24.208809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.211442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.211442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.211442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:24.211442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:24.211789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:24.228568 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.242546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.249892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.259461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8658426c-5ee4-4c94-9261-7fbee81ead21 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.275350 Sep 08 14:10:24.276174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 472/937] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:23 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:24.325955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:24.346029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0ab44b79-8c02-4f0e-a21b-75872e07c61f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1143 microversion: 2.1 time: 0.153007 Sep 08 14:10:24.347041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 466/938] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:24 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1143 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:25.293026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:25.293697 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:25.319822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.320903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.321540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.323436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.324210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.324847 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.370612 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:25.371845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:25.389312 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.390112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.390642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.391929 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:25.392418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:25.392898 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:25.490662 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.501000 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f1abfe2c-3989-4c03-8471-ffa13f973661 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.133922 Sep 08 14:10:25.516360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 467/939] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:25 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:25.603891 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.616171 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.619283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:25.621144 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fa416d1b-ecb0-49f7-a090-9359984ac1f6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.332825 Sep 08 14:10:25.637717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 473/940] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:25 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:10:26.526522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:26.527801 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:26.534937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.535578 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.536244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.537580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.538249 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.538888 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.609035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:26.617426 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5028995a-b608-4fc6-a108-abfaff963069 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.095295 Sep 08 14:10:26.618008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 468/941] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:26 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:26.660604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:26.661854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:26.681991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.682733 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.683308 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.684093 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:26.684690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:26.685158 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:26.867562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:26.881316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:26.882900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:26.884273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5c9b0927-9e50-47b0-b659-441956a9dfbb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.228980 Sep 08 14:10:26.897344 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 474/942] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:26 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:27.641057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:27.641677 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:27.649186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.650141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.650749 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.651459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.652057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.652934 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.733640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:27.742443 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9f66bb0f-c964-44a4-914b-1de4ab7e349d tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.105250 Sep 08 14:10:27.743892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 469/943] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:27 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:27.913942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:27.914572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:27.921449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.922113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.922646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:27.923251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:27.923717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:27.924220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.088194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.102274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.104039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.105444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ec6ca23a-693e-49b9-b71d-d04872813904 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.195811 Sep 08 14:10:28.117434 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 475/944] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:27 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:28.768978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:28.769620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:28.777481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.778192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.778666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.779667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:28.780191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:28.780630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:28.923819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:28.940663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f6fb291e-fe19-49c1-8f53-380fac4bebb8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.175208 Sep 08 14:10:28.941631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 470/945] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:28 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:29.138933 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:29.139561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:29.152263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.152756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.153190 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.154048 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.154509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.154936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.331043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:29.341040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:29.342477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:29.344459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-87189a2b-a53d-4fb7-b7bf-f7aecd59883c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.212394 Sep 08 14:10:29.345124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 476/946] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:29 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:29.968708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:29.970184 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:29.977700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.978186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.978623 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:29.979522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:29.980441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:29.981231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.061885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.075658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e182c9fb-66ca-4ccd-a313-2597204c0895 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.111518 Sep 08 14:10:30.076427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 471/947] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:29 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:30.372940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:30.375776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:30.383962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.384570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.385124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.385937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:30.386577 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:30.387044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:30.548570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.558699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.560355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:30.561832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-638b08a9-bcfc-4fa5-bacc-6222b19fe323 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.193097 Sep 08 14:10:30.564539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 477/948] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:30 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:31.101966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:31.103483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:31.111681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.112622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.113447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.114234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.114812 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.115420 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.189218 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:31.198363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-91c48b8d-5d0c-4d72-a14e-fafb6acdf288 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.100232 Sep 08 14:10:31.199060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 472/949] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:31 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:31.592083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:31.593011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:31.595741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:31.596646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:31.603713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.604615 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.605337 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.607244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:31.608172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:31.608932 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:31.830105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:31.841927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:31.843564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:31.844885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9d0e2808-02ef-40f0-a3ce-ed0570acba33 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.257555 Sep 08 14:10:31.845521 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 478/950] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:31 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:32.225345 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:32.226118 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:32.233020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.233545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.233929 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:32.235114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.235593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.236018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:32.303572 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:32.314064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-40cbb4b5-22e9-454f-b601-880df8931733 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.092881 Sep 08 14:10:32.314940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 473/951] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:32 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:32.877895 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:32.878551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:32.885482 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.885967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.886404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:32.887096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:32.887554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:32.887981 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:33.035606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:33.045005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:33.046518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:33.047756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-418a9e3f-b8d1-43c4-a895-751b7f09e456 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.175129 Sep 08 14:10:33.048409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 479/952] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:32 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:33.338232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:33.338938 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:33.340798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:33.346190 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:33.346978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:33.347416 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:33.348164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:33.348637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:33.349064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:33.415403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:33.415403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:33.419496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0c6f3361-b595-4540-b08a-08b6c41d7379 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1135 microversion: 2.1 time: 0.085248 Sep 08 14:10:33.420082 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 474/953] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:33 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1135 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:34.072987 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:34.073594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:34.079937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.080462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.080904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.081596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.082056 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.082483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.098304 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:34.217423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:34.227005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:34.228478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:34.229884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7d22724e-c6ae-473a-bef3-cd45ee928ec5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.161375 Sep 08 14:10:34.230464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 480/954] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:34 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:34.445787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:34.445787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:34.450552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.451091 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.451540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.452283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.452744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.453730 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.522069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:34.529852 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-38e87bc5-8618-48c5-9349-9c739cd6807a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1191 microversion: 2.1 time: 0.091394 Sep 08 14:10:34.530435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 475/955] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:34 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:35.259762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:35.263202 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:35.269390 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.269925 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.270367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.271642 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.271998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.272530 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.410585 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:35.420085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:35.422051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:35.423235 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ab44920d-6c22-47c7-a070-30b72e7e7984 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.170623 Sep 08 14:10:35.423796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 481/956] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:35 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:35.555477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:35.557817 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:35.566882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.567766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.568614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.569450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:35.570036 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:35.570714 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:35.726877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:35.736203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-83394ebe-9ac3-449e-a5a1-65dc454ee88a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1277 microversion: 2.1 time: 0.185908 Sep 08 14:10:35.739453 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 476/957] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:35 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:36.477283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:36.477283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:36.477283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.477283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.478141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.478141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.478141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.478141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.614869 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:36.625884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:36.627352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:36.628582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b9127616-708c-46f3-a884-3f9e845695dc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.182689 Sep 08 14:10:36.629194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 482/958] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:36 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:36.759227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:36.759920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:36.762610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:36.767796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.768713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.769188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.769907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.770372 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.770815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.881179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37da3ae-5171-4ee2-9574-5de3021c2ef9", "tag": "1e03d08d-9de5-40da-b09e-cdf6ce4f29c4"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:36.891742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:36.892639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:36.893365 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:36.908816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] Creating event network-changed:1e03d08d-9de5-40da-b09e-cdf6ce4f29c4 for instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 on hv-cinder-85646 Sep 08 14:10:36.915695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-bb8e33e0-34f6-4f70-99c3-2fafac077990 req-2080e83f-4e57-4cb3-93c8-24a9f9b02c25 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038166 Sep 08 14:10:36.916739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 483/959] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:37.067792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.076078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4773e02e-b71d-4f0f-8725-278e736da3ea tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1277 microversion: 2.1 time: 0.320629 Sep 08 14:10:37.076764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 477/960] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:36 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1277 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:37.656762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:37.657457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:37.663923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.664430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.664858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.665542 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:37.666147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:37.666576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:37.804335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.813944 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.815392 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:37.816617 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9584a80d-873f-4804-a53b-bffc6a8f72b1 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.165628 Sep 08 14:10:37.817179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 484/961] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:37 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:38.100580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:38.101213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:38.108572 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:38.110377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:38.110377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:38.110377 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:38.110807 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:38.111085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:38.242960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:38.250966 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5362ea2f-f1f2-4dd1-b89e-e719a7f3d768 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1277 microversion: 2.1 time: 0.155026 Sep 08 14:10:38.251538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 478/962] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:38 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:38.843388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:38.844052 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:38.850711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:38.851198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:38.851634 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:38.852358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:38.852818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:38.853249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:38.990892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:39.000452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:39.001920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:39.003106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1c23f8d5-ebeb-4052-9729-fbc09382a3b3 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.164151 Sep 08 14:10:39.003671 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 485/963] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:38 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:39.275668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:39.276375 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:39.283837 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:39.284359 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:39.284803 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:39.285499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:39.285964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:39.286403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:39.422443 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:39.430853 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-6a58f411-bd56-46a9-be36-9123185812ff tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1277 microversion: 2.1 time: 0.158968 Sep 08 14:10:39.431456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 479/964] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:39 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:40.027726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:40.028468 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:40.035546 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:40.043794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:40.043794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:40.043794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:40.043794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:40.044285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:40.189382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:40.199375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:40.201027 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:40.202231 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-381cf400-3097-4e72-9b0f-562d4e6ec2a8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.178626 Sep 08 14:10:40.202888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 486/965] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:40 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:40.464364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:40.466294 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:40.478651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:40.482319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:40.482319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:40.482319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:40.482319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:40.483469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:40.628427 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:40.636494 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d5e2ffa6-15c0-4d9b-9ab5-89e895cf5004 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.185136 Sep 08 14:10:40.637067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 480/966] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:40 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:41.228679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:41.229364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:41.236462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.237081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.237518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.238230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.238684 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.239105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.378574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:41.390191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:41.391785 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:41.392989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2e01618a-a4c6-4c3a-8c49-3314e9cd5a1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.168601 Sep 08 14:10:41.393846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 487/967] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:41 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:41.661243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:41.661874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:41.668790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.669555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.669984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.670697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.671160 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.672607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.817741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:41.825826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da802bc6-b3ed-4391-835f-7fcd5637ad53 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.168398 Sep 08 14:10:41.826775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 481/968] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:41 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:42.418983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:42.419690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:42.422924 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:42.427763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:42.428291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:42.428735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:42.429451 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:42.430097 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:42.430528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:42.569298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:42.579127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:42.580589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:42.581772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b2fdb53e-bacf-44ac-9d15-9e6eab7feab0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.166680 Sep 08 14:10:42.588192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 488/969] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:42 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:42.850441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:42.851068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:42.857649 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:42.858131 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:42.858566 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:42.860069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:42.860628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:42.861063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.008414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:43.016834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8a94a514-e036-4d8f-b2c9-da31d6ac9f70 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.170099 Sep 08 14:10:43.017737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 482/970] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:42 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:43.106955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "name": "network-vif-plugged", "status": "completed", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:43.118540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:43.119017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:43.119446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.134229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] Creating event network-vif-plugged:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:10:43.139443 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-74357626-e03b-4f1a-a7a8-0c93411ca550 req-0ef1d88c-4436-4be9-b4a8-0c25d909b752 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036187 Sep 08 14:10:43.140592 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 489/971] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:43.607325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:43.607997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:43.614711 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:43.615191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:43.615630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.616403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:43.616861 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:43.617289 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.757114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:43.766167 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:43.767618 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:43.768833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-feeafcb3-cb9d-4a11-8c9a-107abbb6d084 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.165696 Sep 08 14:10:43.769465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 483/972] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:43 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:44.041832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:44.042536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:44.050310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.050795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.052238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.052238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.052515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.052951 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.189230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:44.197382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-36cb53aa-350e-4491-9ce3-3429f2ba7997 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.159840 Sep 08 14:10:44.197923 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 490/973] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:44 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:44.795066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:44.795622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:44.802253 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.802737 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.803170 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.803941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.804327 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.810328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.945766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:44.956203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:44.963245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:44.963245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f930db3b-5071-4d56-aef1-6b6d74423fdb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.167899 Sep 08 14:10:44.963245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 484/974] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:44 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:45.222809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:45.223518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:45.230090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:45.230579 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:45.235884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:45.235884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:45.235884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:45.235884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:45.385491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:45.393582 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-179ab7cb-a2d0-4520-9afd-f2973534ea46 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.175289 Sep 08 14:10:45.394044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 491/975] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:45 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:45.984931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:45.985586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:45.991952 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:45.992471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:45.992908 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:45.993607 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:45.994062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:45.994492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:46.129595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:46.138811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:46.140969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:46.142362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-bbce9a15-4991-40eb-a877-a5a304d2f497 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.161804 Sep 08 14:10:46.142964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 485/976] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:45 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:46.420857 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:46.422180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:46.430083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:46.430807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:46.431263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:46.431982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:46.432517 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:46.432954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:46.584794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:46.592554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a7f1b74e-b67e-4521-8c3f-ea5883c7b763 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.177210 Sep 08 14:10:46.593156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 492/977] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:46 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:47.168651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:47.169378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:47.175309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.175792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.176260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.176949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.177398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.177816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.323951 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:47.333353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:47.334808 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:47.336020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-33626dad-7243-408d-aeab-93527e68d991 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1808 microversion: 2.20 time: 0.171332 Sep 08 14:10:47.336674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 486/978] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:47 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:47.615357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:47.615999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:47.622738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.623230 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.623683 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.627707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:47.627707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:47.627707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:47.757147 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:47.767238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-faa83134-ccbc-49e3-8c09-222eb74a5c64 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.155778 Sep 08 14:10:47.767965 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 493/979] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:47 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:48.362877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:48.363531 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:48.371476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.372087 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.372563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.373389 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.373911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.374402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.525069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:48.534999 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:48.536471 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:48.537681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3ba793b3-a2ec-4da0-9bd3-2d942cd15cec tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1795 microversion: 2.20 time: 0.179264 Sep 08 14:10:48.538248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 487/980] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:10:48 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1795 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:10:48.790908 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:48.791525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:48.798372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.798858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.799284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.799971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:48.800448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:48.800871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:48.948381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:48.956421 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cc2796ac-07b5-4613-ba7d-5efc90aee1df tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.169482 Sep 08 14:10:48.957416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 494/981] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:48 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:49.982567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:49.983192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:49.990450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:49.992267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:49.992267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:49.992267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:49.992716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:49.993124 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:50.135341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:50.144299 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-810e6964-698c-4f82-b736-34558eab03d1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.165552 Sep 08 14:10:50.144905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 488/982] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:49 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:51.169798 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:51.170712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:51.192397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.192397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.192397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.194051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.195438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.196124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.296981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37da3ae-5171-4ee2-9574-5de3021c2ef9", "name": "network-vif-plugged", "status": "completed", "tag": "1e03d08d-9de5-40da-b09e-cdf6ce4f29c4"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:51.311316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:51.311957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:51.312608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:51.326384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] Creating event network-vif-plugged:1e03d08d-9de5-40da-b09e-cdf6ce4f29c4 for instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 on hv-cinder-85646 Sep 08 14:10:51.332364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-4c214b68-cd4a-4061-8e0e-705046397c1b req-9d0db645-4819-44e3-90ab-d26e47a7c757 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039996 Sep 08 14:10:51.333713 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 489/983] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:51.371608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:51.381177 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-44136d79-333e-429e-9f74-47de1358e5d8 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.216773 Sep 08 14:10:51.382319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 495/984] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:51 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:52.407510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:52.408284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:52.414920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:52.415423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:52.415856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:52.416781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:52.417242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:52.417667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:52.615252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:52.626683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a71ae932-183e-4f1b-af07-1bc9ccb8c704 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1265 microversion: 2.1 time: 0.223975 Sep 08 14:10:52.628512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 490/985] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:52 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:53.664691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.665292 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:53.672768 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.673305 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.673746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.674461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.674911 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.675455 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.823214 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:53.841220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7caa0623-5782-410c-88d0-1b0b32a5efc7 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1451 microversion: 2.1 time: 0.171570 Sep 08 14:10:53.841220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 496/986] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:53 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:53.855467 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:53.855921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:53.862629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.863115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.863550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:53.864307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:53.864778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:53.865339 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:54.032174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:54.040580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d6bc6a83-ff6c-431f-b341-6bc419a34f3b tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1451 microversion: 2.1 time: 0.188967 Sep 08 14:10:54.041091 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 491/987] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:53 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:56.848543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37da3ae-5171-4ee2-9574-5de3021c2ef9", "tag": "1e03d08d-9de5-40da-b09e-cdf6ce4f29c4"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:56.861704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.862406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.863021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.878233 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] Creating event network-changed:1e03d08d-9de5-40da-b09e-cdf6ce4f29c4 for instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 on hv-cinder-85646 Sep 08 14:10:56.884884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-79806789-7e85-4628-8db5-6d68e53e1e80 req-81df24f8-b944-46c2-8f82-0311ed5ae325 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039763 Sep 08 14:10:56.885975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 497/988] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:11:26.798674 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=29 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:26.799522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=99 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:26.804751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:26.805283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:26.812177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:26.816538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:26.816538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:26.816538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:26.816538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:26.816937 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:26.845963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-10eec603-1c24-43dd-92aa-a9dab172743e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments/fe430b01-19cd-48cd-960f-4ecbff9c927f" status: 200 len: 194 microversion: 2.20 time: 0.048610 Sep 08 14:11:26.846577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 492/989] 10.222.0.97 () {60 vars in 1454 bytes} [Thu Sep 8 14:11:26 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments/fe430b01-19cd-48cd-960f-4ecbff9c927f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:11:26.915505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=19 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:26.916285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=93 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:26.921432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:26.922254 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:26.928416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:26.931403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:26.931403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:26.931403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:26.931403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:26.932131 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:27.020313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lazy-loading 'services' on Instance uuid f4b5a76e-6957-466c-bf07-13e01fd80403 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:11:27.331566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9e8223a1-c639-43f4-8a8e-cf0faa787ca4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments/fe430b01-19cd-48cd-960f-4ecbff9c927f" status: 202 len: 0 microversion: 2.20 time: 0.417734 Sep 08 14:11:27.332183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 498/990] 10.222.0.97 () {60 vars in 1457 bytes} [Thu Sep 8 14:11:26 2022] DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments/fe430b01-19cd-48cd-960f-4ecbff9c927f => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:11:27.348493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:27.348493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:27.366217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:27.367847 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:27.368385 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:27.369119 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:27.369593 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:27.370030 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:27.405819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ee333425-bc50-41fe-aace-07c59edfb4fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068735 Sep 08 14:11:27.406397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 493/991] 10.222.0.97 () {60 vars in 1343 bytes} [Thu Sep 8 14:11:27 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:11:28.421106 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:28.423572 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:28.430573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:28.431209 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:28.432372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:28.433593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:28.434183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:28.434737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:28.470740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5915e797-fbe9-47b0-81f3-286b35e251b8 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054731 Sep 08 14:11:28.471200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 499/992] 10.222.0.97 () {60 vars in 1343 bytes} [Thu Sep 8 14:11:28 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 14:11:29.502833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:29.507658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:29.519336 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:29.520361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:29.521173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:29.522399 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:29.523232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:29.524235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:29.566864 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ef872785-e3a9-4dcb-b679-b2fad6ca5abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071654 Sep 08 14:11:29.566864 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 494/993] 10.222.0.97 () {60 vars in 1343 bytes} [Thu Sep 8 14:11:29 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:29.635762 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:29.636355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:29.643798 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:29.644418 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:29.644926 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:29.645720 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:29.646246 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:29.646676 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:29.673645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:11:30.198156 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e87ac4df-7242-4d84-bec3-cc913dcfe665 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 204 len: 0 microversion: 2.20 time: 0.566531 Sep 08 14:11:30.198756 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 500/994] 10.222.0.97 () {60 vars in 1280 bytes} [Thu Sep 8 14:11:29 2022] DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:11:30.208476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:30.209100 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:30.215227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:30.215722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:30.216187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:30.217552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:30.218043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:30.218478 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:30.371950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:30.381403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:30.382831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:30.384111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ecf83741-a9e9-4ead-9834-ee53c06f398d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.180087 Sep 08 14:11:30.384699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 495/995] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:30 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:31.410686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:31.411498 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:31.418688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:31.419183 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:31.420116 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:31.420961 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:31.421423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:31.422078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:31.558488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:31.567706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:31.569509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:31.570649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7ba50cf2-612c-4b80-96c4-0169d4d5debc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.164378 Sep 08 14:11:31.571226 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 501/996] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:31 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:31.834727 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-697323629", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "networks": [{"uuid": "50ccfe90-5765-42b5-badc-8765793714ff"}]}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:31.891874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] validate_networks() for [('50ccfe90-5765-42b5-badc-8765793714ff', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:11:32.254637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:11:32.255062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:11:32.255568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:11:32.255981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:11:32.256423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:11:32.265863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:32.266368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:32.266816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:32.267708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:32.268221 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:32.268692 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:32.286324 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Getting quotas for project 573d91123526408f88c0a9d7612da26c. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:11:32.290431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Getting quotas for user 68332caf77ed443ea4828e643ff28f85 and project 573d91123526408f88c0a9d7612da26c. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:11:32.303752 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:11:32.306111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:11:32.461715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5ecb4f2e-7284-4fd1-b9bb-fb2c7db63e77 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630762 Sep 08 14:11:32.462396 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 496/997] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:11:32.474251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f24a5276-eca1-4b54-b5cd-f4b2845ae918 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:32.475204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f24a5276-eca1-4b54-b5cd-f4b2845ae918 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:32.539394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f24a5276-eca1-4b54-b5cd-f4b2845ae918 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:32.552081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f24a5276-eca1-4b54-b5cd-f4b2845ae918 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1213 microversion: 2.1 time: 0.081842 Sep 08 14:11:32.552717 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 502/998] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:32 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:32.597867 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:32.598044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:32.605785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:32.609981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:32.609981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:32.609981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:32.609981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:32.610358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:32.757189 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:32.766776 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:32.768316 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:32.769548 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-246937fe-5f72-4204-b8ec-d1b96c163e95 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1723 microversion: 2.20 time: 0.177062 Sep 08 14:11:32.770115 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 497/999] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:32 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:33.015637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b5a76e-6957-466c-bf07-13e01fd80403", "name": "network-vif-deleted", "tag": "095af121-06a2-4c99-a9a4-79ded6b485f1"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:33.037014 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:33.039719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:33.040335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:33.052905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] Creating event network-vif-deleted:095af121-06a2-4c99-a9a4-79ded6b485f1 for instance f4b5a76e-6957-466c-bf07-13e01fd80403 on hv-cinder-85646 Sep 08 14:11:33.058984 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-73f371d8-cfee-4bc8-a49c-ecf1e2d57ca0 req-539a1c55-5de0-43e8-9930-5200e96a68aa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047657 Sep 08 14:11:33.061114 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 503/1000] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:33.577227 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-255bfd6a-685a-4502-9c4d-3bf2736f7201 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:33.577949 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-255bfd6a-685a-4502-9c4d-3bf2736f7201 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:33.633163 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-255bfd6a-685a-4502-9c4d-3bf2736f7201 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:33.641313 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-255bfd6a-685a-4502-9c4d-3bf2736f7201 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1213 microversion: 2.1 time: 0.068308 Sep 08 14:11:33.642565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 498/1001] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:33 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:33.801622 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:33.802525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:33.809081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:33.809725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:33.810471 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:33.811456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:33.812196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:33.812859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:33.850419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:33.851057 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:33.851686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:33.852339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lazy-loading 'fault' on Instance uuid f4b5a76e-6957-466c-bf07-13e01fd80403 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:11:33.897460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:33.907552 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:33.909192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:33.910391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0d10e9c5-ccf8-4554-a45f-237537c7b1ba tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 200 len: 1372 microversion: 2.20 time: 0.113952 Sep 08 14:11:33.914136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 504/1002] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:33 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:34.665647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:34.666381 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:34.675172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:34.675745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:34.676265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:34.677027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:34.677585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:34.678088 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:34.745301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:34.753997 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c01bfa31-2d97-4ef0-bebb-4ab269e81db1 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1209 microversion: 2.1 time: 0.092065 Sep 08 14:11:34.754583 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 499/1003] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:34 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:34.938904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:34.939469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:34.946995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:34.947545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:34.948045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:34.948818 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:34.949362 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:34.949824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:34.967075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 HTTP/1.1 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:11:34.968826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:11:34.974803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f4b5a76e-6957-466c-bf07-13e01fd80403'} Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:11:34.975824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:11:34.978538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:11:34.981110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:11:34.981110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1f5de0ee-9d44-4cdb-bed4-2f9a340775e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 404 len: 111 microversion: 2.20 time: 0.036250 Sep 08 14:11:34.981110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 505/1004] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:34 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 14:11:34.981585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8335c472-8094-43db-95fd-19ba6b50737d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '.version_select at 0x7f7f8aef2790>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:34.993617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8335c472-8094-43db-95fd-19ba6b50737d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [644f8f1c-8635-4cff-8c3e-e45195fbb8c7] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:11:35.778256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:35.778986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:35.785525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:35.786013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:35.786442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:35.787143 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:35.787596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:35.788029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:35.855485 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:35.865630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6af4fbff-185d-4dd0-ad12-a63dd2b24499 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1273 microversion: 2.1 time: 0.091206 Sep 08 14:11:35.866221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 506/1005] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:35 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:36.005220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO oslo.messaging._drivers.impl_rabbit [None req-8335c472-8094-43db-95fd-19ba6b50737d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [644f8f1c-8635-4cff-8c3e-e45195fbb8c7] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 45392. Sep 08 14:11:36.142256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8335c472-8094-43db-95fd-19ba6b50737d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388624436" status: 204 len: 0 microversion: 2.20 time: 1.165525 Sep 08 14:11:36.143178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 500/1006] 10.222.0.97 () {60 vars in 1262 bytes} [Thu Sep 8 14:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388624436 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:11:36.891602 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:36.892238 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:36.898804 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:36.899280 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:36.899750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:36.900497 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:36.900990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:36.901422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:37.063499 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:37.078554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-827904e6-0e63-43b7-b7f5-10247e7a3d43 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.191148 Sep 08 14:11:37.093641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 507/1007] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:36 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:37.189393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-03c58adf-0acf-44fc-84c8-2fd667f656df tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: .version_select at 0x7f7f8ae7b430>, body: {"keypair": {"name": "tempest-keypair-1636180860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJS8OfhxF7n93RJ/9DpViRqQJws6zNfIpStyCEuTceJDovEnlgD7/HowDhg0N641Wtd34ZDGY2bjTRgg0WpJmqhLjbLjaHmB4d8mIQEpylRKBcDXj+IlHG8D2SWdYEJww=="}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:37.210142 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-03c58adf-0acf-44fc-84c8-2fd667f656df tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for project 1abe0ab206094524af0fdde9e6285385. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:11:37.215394 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-03c58adf-0acf-44fc-84c8-2fd667f656df tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for user f5e920d3b3044859b767add41690043c and project 1abe0ab206094524af0fdde9e6285385. Resources: {'key_pairs'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:11:37.368804 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-03c58adf-0acf-44fc-84c8-2fd667f656df tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.184740 Sep 08 14:11:37.369657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 501/1008] 10.222.0.97 () {62 vars in 1200 bytes} [Thu Sep 8 14:11:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 14:11:38.107660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:38.110019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:38.111748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9237e3-03c5-4c9e-97ea-8a96f8787cea", "tag": "81870ee2-80e0-426d-8068-2274f3f863ed"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:38.119141 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:38.119692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:38.120216 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:38.120889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:38.121581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:38.122033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:38.130350 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:38.136408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:38.136408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:38.149637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] Creating event network-changed:81870ee2-80e0-426d-8068-2274f3f863ed for instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea on hv-cinder-85646 Sep 08 14:11:38.155259 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-af890011-f027-400d-8ee4-4f39c735845d req-7955899a-a3b9-41c6-9907-b3548e6f2d36 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049107 Sep 08 14:11:38.155941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 502/1009] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:38.290244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:38.299313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-35154c36-6eb0-4902-b11e-0612073b1d52 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.198113 Sep 08 14:11:38.300345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 508/1010] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:38 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:39.326936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:39.327694 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:39.334815 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:39.335308 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:39.335747 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:39.336514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:39.337003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:39.337458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:39.661530 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:39.670505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-df5891a2-ff91-4b32-8785-4a5dd304129f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.348892 Sep 08 14:11:39.671093 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 503/1011] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:39 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:40.695436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:40.696105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:40.706267 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:40.706761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:40.707274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:40.707977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:40.708625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:40.709063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:40.710357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-758377488", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d613c6-35b4-42be-b5d3-ee46e5ddc1e5"}], "security_groups": [{"name": "tempest-securitygroup--206931636"}], "key_name": "tempest-keypair-1636180860", "user_data": "}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:40.850179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] validate_networks() for [('78d613c6-35b4-42be-b5d3-ee46e5ddc1e5', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:11:40.929251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:40.938146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a111f130-d2f1-48c5-8fe9-81584a418a2c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.246876 Sep 08 14:11:40.938985 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 509/1012] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:40 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:41.251610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:11:41.252123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:11:41.252644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:11:41.253062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:11:41.253483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:11:41.263920 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.264439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.271141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:41.271141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.271141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.271141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:41.286281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for project 1abe0ab206094524af0fdde9e6285385. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:11:41.290440 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Getting quotas for user f5e920d3b3044859b767add41690043c and project 1abe0ab206094524af0fdde9e6285385. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:11:41.302527 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:11:41.304968 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:11:41.546419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ba248395-a417-4acf-be70-2e238f907f2a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.837455 Sep 08 14:11:41.546419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 504/1013] 10.222.0.97 () {62 vars in 1188 bytes} [Thu Sep 8 14:11:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 14:11:41.556802 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:41.559381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:41.620942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:41.626227 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:41.626227 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:41.627155 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d846323e-75c2-41a8-92cd-547bb3d970db tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1281 microversion: 2.20 time: 0.074518 Sep 08 14:11:41.627725 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 510/1014] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:41 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:41.962509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:41.963194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:41.970584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.971070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.971509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:41.972233 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.972695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.973130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:42.123252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:42.132733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f3e3eb06-8132-4021-b07f-dd04f0379663 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.174471 Sep 08 14:11:42.133642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 505/1015] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:41 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:42.651416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:42.652033 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:42.658599 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:42.659083 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:42.659525 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:42.660372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:42.660841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:42.666721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:42.727515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:42.737332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:42.738863 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:42.740000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a7b5dcfc-6904-43d1-888c-a4823d10daff tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1285 microversion: 2.20 time: 0.092630 Sep 08 14:11:42.740593 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 511/1016] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:42 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:43.162526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:43.163745 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:43.173195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.173698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.174145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.174945 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.175414 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.175850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.328126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:43.338608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7f7d8a56-f4f4-448e-9a80-8937cb5a4aa6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.182248 Sep 08 14:11:43.338608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 506/1017] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:43 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:43.601814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9237e3-03c5-4c9e-97ea-8a96f8787cea", "name": "network-vif-plugged", "status": "completed", "tag": "81870ee2-80e0-426d-8068-2274f3f863ed"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:43.601814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.601814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.601814 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.605488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] Creating event network-vif-plugged:81870ee2-80e0-426d-8068-2274f3f863ed for instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea on hv-cinder-85646 Sep 08 14:11:43.610657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-127cca50-10ff-4bc4-b255-3a5682007797 req-7c08a08e-7f9b-48c5-bf3b-84ba4f4f4041 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Sep 08 14:11:43.611272 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 512/1018] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:43.768042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:43.768869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:43.775739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.776307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.776835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.777666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.778383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.779020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.854197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:43.863476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:43.865029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:43.866255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d992bba2-0d54-412b-b6f8-64e8fc94cdcf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1333 microversion: 2.20 time: 0.103931 Sep 08 14:11:43.881855 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 507/1019] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:43 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:44.361884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:44.362703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:44.369218 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:44.373948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:44.373948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:44.373948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:44.373948 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:44.374554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:44.741596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:44.749966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5173d819-1b85-4365-b966-bf0055bc1ff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.393542 Sep 08 14:11:44.750551 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 513/1020] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:44 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:44.893955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:44.894527 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:44.901490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:44.901988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:44.902451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:44.903196 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:44.903683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:44.904200 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:44.989602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:44.998844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:45.000402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:45.001924 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8bd8a793-d467-470a-ba36-0ae8103d732c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1341 microversion: 2.20 time: 0.112162 Sep 08 14:11:45.002597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 508/1021] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:44 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:45.775937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:45.777124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:45.787361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:45.788290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:45.788976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:45.790091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:45.790816 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:45.791491 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:45.975160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:46.001481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dc7b47a2-8ca5-43f3-b531-bbaeb9e0736f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1313 microversion: 2.1 time: 0.225375 Sep 08 14:11:46.001481 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 514/1022] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:45 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:46.027800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:46.028325 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:46.036392 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:46.037267 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:46.037895 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:46.038816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:46.039460 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:46.040069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:46.228355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:46.244466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:46.244466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:46.244466 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-62ba3516-49f6-4578-b691-661deb00070b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1418 microversion: 2.20 time: 0.219096 Sep 08 14:11:46.244981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 509/1023] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:46 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1418 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:47.017793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:47.018409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:47.027322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.032193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.032193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.032193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.032193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.032936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.175492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:47.179216 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:47.184379 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7edb7c63-0d6b-4aee-b6d2-3728b7879649 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1498 microversion: 2.1 time: 0.170694 Sep 08 14:11:47.188440 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 515/1024] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:47 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:47.271241 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:47.272413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:47.281429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.282292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.282911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.283971 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.284637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.285232 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.459921 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:47.471542 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:47.473040 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:47.474163 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fc916f3e-bcc0-479c-a5a1-ca27b651e2c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.208387 Sep 08 14:11:47.474733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 510/1025] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:47 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:47.611172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:47.625208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.626018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.626461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.641306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] Creating event network-changed:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:11:47.646276 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-339c372e-9054-4ba4-86bb-11626c58f75f req-d6621293-a297-4f05-a7ea-9ae287685374 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040173 Sep 08 14:11:47.647332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 516/1026] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:48.499743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:48.500433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:48.507185 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.515238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.515238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.515238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.515238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.515667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.657006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:48.665793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:48.667252 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:48.668424 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-89627456-e921-47df-a96d-5ef1e3c95d28 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.173249 Sep 08 14:11:48.669515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 511/1027] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:48 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:48.818519 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:48.819488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:48.826767 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.834229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.834229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.834229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.834229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.834698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.858788 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:11:49.326152 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-88e30bdd-e0f8-444f-a89f-92fc01c2e2fd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "DELETE /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 204 len: 0 microversion: 2.1 time: 0.511968 Sep 08 14:11:49.326776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 517/1028] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:11:48 2022] DELETE /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:11:49.336967 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:49.337641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:49.344078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.344475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.344914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.345651 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.346167 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.346599 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.483452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:49.493449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e862987f-6e94-4185-b1eb-04fb7da340ef tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1504 microversion: 2.1 time: 0.161899 Sep 08 14:11:49.494095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 512/1029] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:49 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:49.695848 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:49.696494 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:49.702991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.704078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.704078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.704648 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.705108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.705538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.841758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:49.850693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:49.852204 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:49.853340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9c03f917-ae9a-41eb-b1fe-faf3ff24cd8e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.162242 Sep 08 14:11:49.853914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 518/1030] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:49 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:50.519500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:50.520298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:50.527209 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.527719 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.528199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:50.528967 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.529431 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.529919 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:50.549857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:50.671421 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:50.679809 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-570b3114-1e6c-44d1-909e-1dc1c0cdbff2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1504 microversion: 2.1 time: 0.164377 Sep 08 14:11:50.680461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 513/1031] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:50 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:50.880051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:50.880660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:50.887807 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.888399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.888859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:50.889753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.890226 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.890655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.028306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:51.036662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:51.038099 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:51.039207 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4430fd73-2052-4ff5-82be-47ca84593ccc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.163371 Sep 08 14:11:51.039776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 519/1032] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:50 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:51.239899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-709799550", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "networks": [{"uuid": "edcff5a5-b489-4160-904f-0b970dd89303"}]}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:51.274490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:51.295948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.network.neutron [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] validate_networks() for [('edcff5a5-b489-4160-904f-0b970dd89303', None, None, None, None, None)] {{(pid=128401) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:11:51.311253 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=18 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:51.705962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:51.706889 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:51.712538 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=4 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:51.714851 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.715545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.716071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.717611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.718305 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.718941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.767639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Flavor limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:11:51.768742 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Image limits 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:11:51.769328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Flavor pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:11:51.769814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Image pref 0:0:0 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:11:51.770306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.virt.hardware [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:11:51.780306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.780913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.781425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.782264 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.782796 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.783296 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.803078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Getting quotas for project d3cad599cd5943e8b545de7bacca6fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:11:51.826447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.quota [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Getting quotas for user ae8540a6f24149abbab456ca1c6b33c7 and project d3cad599cd5943e8b545de7bacca6fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=128401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:11:51.826447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:51.826447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Going to run 1 instances... {{(pid=128401) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:11:51.826447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:11:51.878603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:51.887436 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c5d3d1ec-a054-4348-956c-e8e53c69cef6 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1504 microversion: 2.1 time: 0.185387 Sep 08 14:11:51.888406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 520/1033] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:51 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:52.052448 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2663bb8c-a0fb-4c1c-a69f-422d89ce9da4 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816432 Sep 08 14:11:52.053434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 514/1034] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:11:52.066018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:52.066674 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:52.068762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-690e3c96-fac5-42d5-ac5e-6990f1f0d400 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:52.069682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-690e3c96-fac5-42d5-ac5e-6990f1f0d400 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:52.075370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.075880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.076900 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.077296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.077623 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.078139 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.155475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-690e3c96-fac5-42d5-ac5e-6990f1f0d400 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:52.173602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-690e3c96-fac5-42d5-ac5e-6990f1f0d400 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1218 microversion: 2.1 time: 0.110360 Sep 08 14:11:52.175671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 515/1035] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:52 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:52.195633 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9237e3-03c5-4c9e-97ea-8a96f8787cea", "name": "network-vif-deleted", "tag": "81870ee2-80e0-426d-8068-2274f3f863ed"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:52.207814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.208894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.210594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.227702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] Creating event network-vif-deleted:81870ee2-80e0-426d-8068-2274f3f863ed for instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea on hv-cinder-85646 Sep 08 14:11:52.235379 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-f2def215-57f8-4e0b-8d0c-2750427ebe11 req-8bd3ca00-253c-4653-bcdd-767bf552a00e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048813 Sep 08 14:11:52.236988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 516/1036] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:11:52.289934 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:52.299984 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:52.302550 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:52.304657 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3e4f07e1-6831-4542-ba86-80022fe53a5c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.242541 Sep 08 14:11:52.305573 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 521/1037] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:52 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:11:52.911998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:52.912781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:52.919699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.920216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.920663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.921373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.921838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.922268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.959380 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.959878 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.960356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.960816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lazy-loading 'fault' on Instance uuid 3b9237e3-03c5-4c9e-97ea-8a96f8787cea {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:11:53.007588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.016747 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-52c29b59-afaf-45a1-9105-a54da81a4207 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1303 microversion: 2.1 time: 0.109416 Sep 08 14:11:53.017333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 517/1038] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:52 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:53.202386 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9170c5da-d390-40bb-8f55-5cc4beccd85d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:53.202971 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9170c5da-d390-40bb-8f55-5cc4beccd85d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:53.258553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9170c5da-d390-40bb-8f55-5cc4beccd85d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.267124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9170c5da-d390-40bb-8f55-5cc4beccd85d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1218 microversion: 2.1 time: 0.069688 Sep 08 14:11:53.268108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 522/1039] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:53 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:53.332495 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:53.333275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:53.340634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:53.341250 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:53.341750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:53.342521 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:53.343089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:53.343641 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:53.505044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.513743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.515206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.516376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1545ed12-d4b9-4021-95aa-3db8de0c62b7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.188976 Sep 08 14:11:53.516957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 518/1040] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:53 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:54.040409 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:54.041127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:54.055428 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.055935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.056396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.060090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.060090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.060090 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.093875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.094370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.094809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.095237 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lazy-loading 'fault' on Instance uuid 3b9237e3-03c5-4c9e-97ea-8a96f8787cea {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:11:54.102766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "name": "network-vif-plugged", "status": "completed", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:54.126066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.126582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.127019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.140191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] Creating event network-vif-plugged:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:11:54.142268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:54.144746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-4fb4e0d0-b639-4122-864e-9a2a40d98387 req-e15464c5-2e3d-4c49-9d6f-0576278cd797 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045848 Sep 08 14:11:54.145367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 519/1041] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:54.152701 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7aafc3f7-a793-434a-97b8-21fef37863ab tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 200 len: 1303 microversion: 2.1 time: 0.116168 Sep 08 14:11:54.155821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 523/1042] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:54 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:54.291383 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-20a41896-2b05-44af-a970-802dfcd3ccd5 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:54.292004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-20a41896-2b05-44af-a970-802dfcd3ccd5 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:54.347558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-20a41896-2b05-44af-a970-802dfcd3ccd5 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:54.355783 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-20a41896-2b05-44af-a970-802dfcd3ccd5 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1218 microversion: 2.1 time: 0.068491 Sep 08 14:11:54.356461 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 520/1043] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:54 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:54.542089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:54.542673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:54.549316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.549801 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.550244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.550975 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:54.551464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:54.551896 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:54.714907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:54.724495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:54.726043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:54.727942 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5bafbf11-410f-40d8-86d0-7a1dfe7506bb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.189473 Sep 08 14:11:54.729198 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 524/1044] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:54 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:55.177072 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:55.177699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 3b9237e3-03c5-4c9e-97ea-8a96f8787cea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:55.186283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.186785 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.187281 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.188009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.188500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.189032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.204458 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] HTTP exception thrown: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Request method failure captured: Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea HTTP/1.1 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfgRK_efM3ytwHiDJxs1i3t4-UdmOf_w762nyGwgwPVoyDAGeV8ahk-1hyGoaeaghFPApJGZigTssoLmOAcqLdGqsRil-TlWh3HuRDslROfn3AMRWvfGiZxjXQxkpD6IVisZ7BTqgu4Od2L-0R_qqOsn1krrbSOCr6uie200bDR7rH8 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 573d91123526408f88c0a9d7612da26c Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesActionsTest-1494653569 Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:11:55.206180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/573d91123526408f88c0a9d7612da26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/573d91123526408f88c0a9d7612da26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/573d91123526408f88c0a9d7612da26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_573d91123526408f88c0a9d7612da26c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesActionsTest-1494653569 Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 573d91123526408f88c0a9d7612da26c Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesActionsTest-1494653569 Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesActionsTest-1494653569-project Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 68332caf77ed443ea4828e643ff28f85 Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesActionsTest-1494653569-project Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. Sep 08 14:11:55.208770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '3b9237e3-03c5-4c9e-97ea-8a96f8787cea'} Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:11:55.210465 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. Sep 08 14:11:55.213357 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:11:55.215652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Returning 404 to user: Instance 3b9237e3-03c5-4c9e-97ea-8a96f8787cea could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:11:55.215652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ac7b4680-dc2c-4b47-acbf-b25c2cfe8bf2 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea" status: 404 len: 111 microversion: 2.1 time: 0.036051 Sep 08 14:11:55.215652 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 521/1045] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:55 2022] GET /compute/v2.1/servers/3b9237e3-03c5-4c9e-97ea-8a96f8787cea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:11:55.312888 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1698854951", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "networks": [{"uuid": "50ccfe90-5765-42b5-badc-8765793714ff"}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:55.375268 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] validate_networks() for [('50ccfe90-5765-42b5-badc-8765793714ff', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:11:55.379565 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:55.380581 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:55.387604 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.388264 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.388770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.389584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.390149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.390731 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.477788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:55.487057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e91f7937-51cf-487f-86b0-45e0714379d8 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1270 microversion: 2.1 time: 0.111505 Sep 08 14:11:55.487792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 522/1046] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:55 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:55.753981 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:55.754614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:55.761646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.762342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.763139 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.764012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.765990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.766609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.795478 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:11:55.795993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:11:55.796391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:11:55.796806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:11:55.797260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:11:55.806430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.806918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.807355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.808124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:55.808718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:55.809155 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:55.827955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Getting quotas for project 573d91123526408f88c0a9d7612da26c. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:11:55.832298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Getting quotas for user 68332caf77ed443ea4828e643ff28f85 and project 573d91123526408f88c0a9d7612da26c. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:11:55.844906 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:11:55.847216 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:11:55.907003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:55.917511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:55.919923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:55.921329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5b362f67-6a28-42c6-acfd-c021231bd137 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1406 microversion: 2.20 time: 0.171215 Sep 08 14:11:55.921977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 523/1047] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:55 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:11:56.028915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-da2dec50-cf7c-4a4b-b4f9-77c4018cb152 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720284 Sep 08 14:11:56.030737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 525/1048] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:11:56.041143 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9fc20068-fde0-44ba-936f-ab4e6c4b640f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:56.041793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9fc20068-fde0-44ba-936f-ab4e6c4b640f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:56.096664 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9fc20068-fde0-44ba-936f-ab4e6c4b640f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:56.103764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9fc20068-fde0-44ba-936f-ab4e6c4b640f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1214 microversion: 2.1 time: 0.066396 Sep 08 14:11:56.104412 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 524/1049] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:56 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:56.511011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:56.511633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:56.518660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:56.521732 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:56.521732 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:56.521732 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:56.521732 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:56.522100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:56.595705 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:56.612580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4b87dc67-6093-4436-b98e-2bbbbf0441e7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1270 microversion: 2.1 time: 0.097943 Sep 08 14:11:56.612580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 526/1050] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:56 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:56.947158 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:56.947897 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:56.954927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:56.955525 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:56.956029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:56.956820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:56.957346 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:56.957942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:57.120846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:57.123860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:57.125348 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:57.126518 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8506db25-5340-45eb-b183-08abe29869d7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1598 microversion: 2.20 time: 0.183720 Sep 08 14:11:57.127071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 525/1051] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:11:56 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:11:57.127341 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ae4097ac-5810-4b5e-b242-9ccdc05b1980 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:57.127995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ae4097ac-5810-4b5e-b242-9ccdc05b1980 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:57.129916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:57.152214 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:57.152695 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:57.159356 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:57.159828 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:57.160285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:57.160991 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:57.161439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:57.161989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:57.220296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ae4097ac-5810-4b5e-b242-9ccdc05b1980 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:57.220296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ae4097ac-5810-4b5e-b242-9ccdc05b1980 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1214 microversion: 2.1 time: 0.069108 Sep 08 14:11:57.220296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 527/1052] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:57 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:57.243988 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b7214051-9729-4b0f-bc59-db0a47a8b046 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095971 Sep 08 14:11:57.244621 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 526/1053] 10.222.0.97 () {60 vars in 1316 bytes} [Thu Sep 8 14:11:57 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 14:11:57.630240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:57.630826 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:57.637792 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:57.638289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:57.638728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:57.639452 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:57.639907 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:57.640401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:57.711809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:57.719822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fd223b33-67ea-4f26-b816-30f6e8ee6c7c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1276 microversion: 2.1 time: 0.095517 Sep 08 14:11:57.721076 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 528/1054] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:57 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:58.233976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:58.234910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:58.252915 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:58.253415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:58.254080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:58.254814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:58.255278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:58.255715 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:58.326475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:58.334894 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e799ae97-1604-49c1-a53e-903e56e7794e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1266 microversion: 2.1 time: 0.106988 Sep 08 14:11:58.335492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 527/1055] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:58 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:58.706244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:58.719221 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:58.719736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:58.720252 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:58.733853 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] Creating event network-changed:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:11:58.739730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-ebc4d497-a4bd-4ba0-adf6-45bde658b85e req-5c1a1776-9f0e-4390-a04a-1463967fe622 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037355 Sep 08 14:11:58.740454 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 529/1056] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:11:58.749225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:58.749904 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:58.756932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:58.757402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:58.757888 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:58.758818 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:58.759285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:58.759911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:58.930637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:58.943805 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fc20f798-587c-406d-8ac3-a929574b7e6f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.198389 Sep 08 14:11:58.945194 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 528/1057] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:58 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:59.362100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:59.363179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:59.381880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:59.382534 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:59.383258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:59.384110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:59.384860 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:59.385244 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:59.466388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:59.477518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8bacc50a-cdb0-4d8a-a3a5-4ed10a00b5e5 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1274 microversion: 2.1 time: 0.119929 Sep 08 14:11:59.478766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 530/1058] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:59 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:59.969268 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:59.970172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:59.976567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:59.977066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:59.977529 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:59.978237 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:59.978706 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:59.979276 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:00.123743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:00.131613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-336a8285-aeda-4af3-9540-8562a2a43b99 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.167047 Sep 08 14:12:00.132200 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 529/1059] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:59 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:00.502022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:00.502629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:00.509178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:00.509678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:00.510118 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:00.510830 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:00.511296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:00.511730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:00.581322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:00.590193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f893f633-057e-4bbc-b678-0306efc614ad tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1272 microversion: 2.1 time: 0.092043 Sep 08 14:12:00.591628 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 531/1060] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:00 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:00.895195 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4318d52b-b2a3-4c02-a43a-84984ad95d1f", "tag": "2c4518dd-915b-4338-bcf5-9033afa4cefa"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:00.905397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:00.905880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:00.906319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:00.923073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] Creating event network-changed:2c4518dd-915b-4338-bcf5-9033afa4cefa for instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f on hv-cinder-85646 Sep 08 14:12:00.928213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-e096695a-1490-4e1e-adb8-7f7defd49c3f req-d8b4c7b8-33e7-4111-b3d1-ee93993a26e8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038100 Sep 08 14:12:00.929342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 530/1061] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:01.157158 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:01.158049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:01.164754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:01.165247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:01.165691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:01.166595 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:01.166986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:01.167438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:01.316754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:01.326457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6daba0cb-4ebc-422d-88bd-eb8a48be2105 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.173414 Sep 08 14:12:01.327042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 532/1062] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:01 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:01.616528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:01.617301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:01.624184 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:01.624691 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:01.625133 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:01.625877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:01.626341 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:01.626892 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:01.770397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:01.778574 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d9bc0e1f-3b6e-492b-adfd-155dff59b76e tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.167132 Sep 08 14:12:01.779236 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 531/1063] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:01 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:02.349845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:02.350464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:02.357636 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:02.358121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:02.365107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:02.365107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:02.365107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:02.365107 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:02.498535 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:02.506526 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b6d7e3a2-71e0-4db6-bf70-d9644157a39a tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.160664 Sep 08 14:12:02.507094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 533/1064] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:02 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:02.802150 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:02.802826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:02.804912 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=2 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:02.811073 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:02.811558 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:02.811995 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:02.812721 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:02.813180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:02.813625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:02.944606 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6683e314-98da-4de5-90aa-4f0ba0c9a993", "tag": "22aeedc5-ed7f-45c3-847f-4926eb5fe693"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:02.950201 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:02.954727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:02.955289 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:02.955793 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:02.958789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-62811958-cb1a-49bf-b614-e9f6d7c98afa tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.160401 Sep 08 14:12:02.962862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 532/1065] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:02 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:02.967610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] Creating event network-changed:22aeedc5-ed7f-45c3-847f-4926eb5fe693 for instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 on hv-cinder-85646 Sep 08 14:12:02.972662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-8e1e5585-8dbc-4557-9e81-f7cdebf4075b req-b7a2f2a6-e3ed-41bd-9d43-adcf53152219 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Sep 08 14:12:02.976343 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 534/1066] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:03.530552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:03.531202 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:03.538223 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:03.538712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:03.539150 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:03.539846 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:03.540349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:03.541047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:03.681673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:03.690865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-86294984-0e50-420f-beb8-7651c63dc634 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.164681 Sep 08 14:12:03.691724 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 533/1067] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:03 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:03.984490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:03.985196 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:03.991366 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:03.991854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:03.992326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:03.993026 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:03.993490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:03.993917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:03.999340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:04.133185 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:04.141165 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-944701d2-45eb-423f-8ef9-fa786d5de977 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.162126 Sep 08 14:12:04.142502 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 535/1068] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:03 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:04.715080 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:04.716342 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:04.723126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:04.723613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:04.724052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:04.724781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:04.726890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:04.726890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:05.072120 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:05.080866 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9a639917-efd8-4133-bfdc-b09567195f69 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.369714 Sep 08 14:12:05.081452 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 534/1069] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:04 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:05.164384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:05.164999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:05.172460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:05.173005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:05.173449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:05.174151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:05.174610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:05.175036 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:05.313113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:05.316389 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-04259e0b-3b4a-44ee-a41b-ef4091d11447 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.156209 Sep 08 14:12:05.316973 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 536/1070] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:05 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:06.102909 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:06.103551 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:06.106540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=12 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:06.111755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:06.111909 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:06.112353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:06.113133 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:06.113588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:06.114012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:06.251331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:06.259817 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-03e9259d-122b-4fc7-b97a-445882825191 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.160678 Sep 08 14:12:06.260419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 535/1071] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:06 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:06.341032 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:06.341643 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:06.343501 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:06.349042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:06.349528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:06.349956 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:06.350649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:06.351103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:06.351524 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:06.489422 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:06.503446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-841c9efc-dc61-479e-8bd0-8c3f01bc6d3f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.166780 Sep 08 14:12:06.505772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 537/1072] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:06 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:07.283055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:07.283653 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:07.290606 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:07.291084 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:07.291516 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:07.292236 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:07.292689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:07.293112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:07.311613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:07.432128 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:07.442810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-711d53d9-01d5-4d43-8453-4587a0ce9df9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.163627 Sep 08 14:12:07.443811 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 536/1073] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:07 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:07.527989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:07.528640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:07.530644 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=10 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:07.536240 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:07.536699 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:07.537146 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:07.537854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:07.538316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:07.538835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:07.681315 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:07.689937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-0cb3498d-f116-44a6-ac0d-5e5d9688602c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.166546 Sep 08 14:12:07.690513 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 538/1074] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:07 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:07.813408 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4318d52b-b2a3-4c02-a43a-84984ad95d1f", "name": "network-vif-plugged", "status": "completed", "tag": "2c4518dd-915b-4338-bcf5-9033afa4cefa"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:07.823145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:07.823630 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:07.824069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:07.835265 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] Creating event network-vif-plugged:2c4518dd-915b-4338-bcf5-9033afa4cefa for instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f on hv-cinder-85646 Sep 08 14:12:07.841050 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-999dfbd5-addc-4cf1-b5c1-6d720ccf9b49 req-166b023a-cb7c-4b9c-8969-364900ad4f88 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Sep 08 14:12:07.841657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 537/1075] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:08.466892 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:08.467515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:08.473490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:08.473992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:08.474431 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:08.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:08.475589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:08.476022 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:08.609089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:08.617846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d9c9aa17-e1f0-4194-b2f8-6940c83af058 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.155345 Sep 08 14:12:08.629018 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 539/1076] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:08 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:08.714720 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:08.715374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:08.722354 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:08.722910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:08.723362 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:08.724071 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:08.724567 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:08.725001 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:08.859992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:08.867738 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f716ac5f-4555-4622-95d6-cbbf4ba7cc16 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.157943 Sep 08 14:12:08.868332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 538/1077] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:08 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:09.641437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:09.642138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:09.648667 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:09.649160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:09.649604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:09.650319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:09.650777 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:09.651211 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:09.796594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:09.804765 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-613e6cb0-db97-4a0d-8d7b-8d213e5196bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1318 microversion: 2.1 time: 0.167124 Sep 08 14:12:09.805496 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 540/1078] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:09 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:09.857887 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6683e314-98da-4de5-90aa-4f0ba0c9a993", "name": "network-vif-plugged", "status": "completed", "tag": "22aeedc5-ed7f-45c3-847f-4926eb5fe693"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:09.868348 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:09.868845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:09.869283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:09.880909 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] Creating event network-vif-plugged:22aeedc5-ed7f-45c3-847f-4926eb5fe693 for instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 on hv-cinder-85646 Sep 08 14:12:09.885958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-64505585-d935-4dbc-987e-3dfd44a5826c req-72957a12-fe27-43a1-829c-1247a52c4502 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031814 Sep 08 14:12:09.886654 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 539/1079] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:09.892916 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:09.893532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:09.899404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:09.899880 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:09.900358 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:09.901039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:09.901490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:09.901915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:10.040959 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:10.049160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-acfe27b8-51f4-434d-ba8a-d870541c980f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.159938 Sep 08 14:12:10.049750 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 541/1080] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:09 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:10.832723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:10.833351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:10.839555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:10.840045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:10.841055 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:10.841751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:10.842213 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:10.842644 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:10.976441 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:10.985035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-203f635e-ba55-4048-96cb-f6fc7e1ccc90 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1508 microversion: 2.1 time: 0.156739 Sep 08 14:12:10.985620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 540/1081] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:10 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:11.072871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:11.073492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:11.080580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:11.081073 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:11.081594 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:11.082296 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:11.082806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:11.083186 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:11.224710 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:11.232940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d8ff64ce-bdfe-4d33-b677-03395e73272f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.163808 Sep 08 14:12:11.233737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 542/1082] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:11 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:12.254976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:12.255588 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:12.262665 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:12.263147 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:12.263579 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:12.264291 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:12.264774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:12.265172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:12.400595 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:12.409403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ba8034d3-296a-4835-a0a3-7c3a0adb4470 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1314 microversion: 2.1 time: 0.158319 Sep 08 14:12:12.409982 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 541/1083] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:12 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:13.432357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:13.433193 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:13.441020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:13.441596 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:13.441970 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:13.442678 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:13.443172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:13.443859 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:13.581680 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:13.590023 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-410165a6-3aae-4700-acd1-6d3d07d8f42c tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1499 microversion: 2.1 time: 0.161939 Sep 08 14:12:13.593303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 543/1084] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:13 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1499 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:14.792038 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:14.792840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:14.799975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:14.800492 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:14.800927 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:14.801629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:14.802188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:14.802591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:14.832250 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:12:15.231255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-75730394-c376-4b8b-85a8-511278d6c3dd tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 204 len: 0 microversion: 2.1 time: 0.442742 Sep 08 14:12:15.231869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 542/1085] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:12:14 2022] DELETE /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:12:15.240645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:15.243402 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:15.249945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:15.250446 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:15.250884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:15.251643 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:15.252109 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:15.252571 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:15.420087 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:15.430416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-31d5cad3-ced6-405e-955f-d0edcd01ce0f tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1505 microversion: 2.1 time: 0.193720 Sep 08 14:12:15.431377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 544/1086] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:15 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:16.474369 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:16.475078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:16.481964 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:16.482447 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:16.482884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:16.483602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:16.484035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:16.484485 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:16.644689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:16.653838 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c1adf595-3197-4525-8e42-ddd3ed5cb6e3 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1505 microversion: 2.1 time: 0.184763 Sep 08 14:12:16.654450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 543/1087] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:16 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:17.680325 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:17.681081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:17.689220 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:17.689840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:17.690376 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:17.691194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:17.691797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:17.692352 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:17.714540 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6683e314-98da-4de5-90aa-4f0ba0c9a993", "name": "network-vif-deleted", "tag": "22aeedc5-ed7f-45c3-847f-4926eb5fe693"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:17.724605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:17.725077 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:17.725511 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:17.736797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] Creating event network-vif-deleted:22aeedc5-ed7f-45c3-847f-4926eb5fe693 for instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 on hv-cinder-85646 Sep 08 14:12:17.742101 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-b5dc4921-bf41-4d4f-b60f-d10031cd43bd req-e22617b7-a8d5-437f-a585-e292a9100851 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Sep 08 14:12:17.743016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 544/1088] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:17.767354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:17.775844 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5fc52e42-00b5-410e-b485-e9a06167bd4d tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1463 microversion: 2.1 time: 0.100391 Sep 08 14:12:17.781151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 545/1089] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:17 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:18.801206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:18.801940 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:18.809560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:18.810275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:18.810476 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:18.811182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:18.811640 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:18.812065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:18.844557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:18.845042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:18.845481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:18.847890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lazy-loading 'fault' on Instance uuid 6683e314-98da-4de5-90aa-4f0ba0c9a993 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:18.888824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68332caf77ed443ea4828e643ff28f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573d91123526408f88c0a9d7612da26c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:18.896762 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8d47b3a4-0487-4ecc-8625-1a0c9ec8687a tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 200 len: 1304 microversion: 2.1 time: 0.099805 Sep 08 14:12:18.897335 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 545/1090] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:18 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:19.921187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:19.921930 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] [instance: 6683e314-98da-4de5-90aa-4f0ba0c9a993] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:19.929554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:19.929554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:19.929554 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:19.929986 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:19.930372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:19.930796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:19.944920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] HTTP exception thrown: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Request method failure captured: Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 HTTP/1.1 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfgRK_efM3ytwHiDJxs1i3t4-UdmOf_w762nyGwgwPVoyDAGeV8ahk-1hyGoaeaghFPApJGZigTssoLmOAcqLdGqsRil-TlWh3HuRDslROfn3AMRWvfGiZxjXQxkpD6IVisZ7BTqgu4Od2L-0R_qqOsn1krrbSOCr6uie200bDR7rH8 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 573d91123526408f88c0a9d7612da26c Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesActionsTest-1494653569 Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:12:19.946560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/573d91123526408f88c0a9d7612da26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/573d91123526408f88c0a9d7612da26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/573d91123526408f88c0a9d7612da26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_573d91123526408f88c0a9d7612da26c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesActionsTest-1494653569 Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 573d91123526408f88c0a9d7612da26c Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesActionsTest-1494653569 Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesActionsTest-1494653569-project Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 68332caf77ed443ea4828e643ff28f85 Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesActionsTest-1494653569-project Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. Sep 08 14:12:19.948330 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '6683e314-98da-4de5-90aa-4f0ba0c9a993'} Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:12:19.949170 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. Sep 08 14:12:19.950727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:12:19.952162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] Returning 404 to user: Instance 6683e314-98da-4de5-90aa-4f0ba0c9a993 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:12:19.952162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d6d34775-21bc-487f-b97c-f003ede08c49 tempest-VolumesActionsTest-1494653569 tempest-VolumesActionsTest-1494653569-project] 10.222.0.97 "GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993" status: 404 len: 111 microversion: 2.1 time: 0.031537 Sep 08 14:12:19.952162 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 546/1091] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:19 2022] GET /compute/v2.1/servers/6683e314-98da-4de5-90aa-4f0ba0c9a993 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:30.927627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "903480cd-1d12-4aef-8bcd-cbdd33a9c5df", "device": "/dev/sdb"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:30.930735 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:30.933862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:30.935116 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:30.940053 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:30.940793 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:30.941390 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:30.942301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:30.942830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:30.943251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:32.186172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5b8ae646-a456-47dc-9499-49927a6116a1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "POST /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.262332 Sep 08 14:12:32.193155 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 546/1092] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:12:30 2022] POST /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f/os-volume_attachments => generated 194 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:37.494155 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:37.495359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:37.499081 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=41 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:37.500695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=66 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:37.512460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:37.520806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:37.520806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:37.520806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:37.520806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:37.521225 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:37.582616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:12:37.851183 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37da3ae-5171-4ee2-9574-5de3021c2ef9", "tag": "1e03d08d-9de5-40da-b09e-cdf6ce4f29c4"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:37.863734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:37.864698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:37.865301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:37.881114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] Creating event network-changed:1e03d08d-9de5-40da-b09e-cdf6ce4f29c4 for instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 on hv-cinder-85646 Sep 08 14:12:37.887104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-258cef13-1a01-457a-9bbe-628cdd8f268d req-96246a22-41ec-4e5a-b0d3-ce71605b0231 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393646 Sep 08 14:12:37.888009 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 547/1093] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:38.067515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-aba89270-38d7-458b-b98d-512620d1a572 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 204 len: 0 microversion: 2.1 time: 0.577498 Sep 08 14:12:38.069332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 547/1094] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:12:37 2022] DELETE /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:12:38.078911 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:38.079586 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:38.106573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.107084 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.107523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.108274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:38.108736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:38.109165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:38.369240 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:38.388589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fd8f4721-ce22-43d1-b459-5ba53c5616ab tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1575 microversion: 2.1 time: 0.314255 Sep 08 14:12:38.389833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 548/1095] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:38 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1575 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:39.417000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:39.418066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:39.438489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:39.439210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:39.439748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:39.440740 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:39.441541 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:39.442349 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:39.604621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:39.614029 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-369b0266-aa30-48e1-a31f-7015592f121f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1575 microversion: 2.1 time: 0.203955 Sep 08 14:12:39.614630 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 548/1096] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:39 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:40.639415 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:40.642708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:40.651235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:40.652114 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:40.652825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:40.653763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:40.654429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:40.655090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:40.878819 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:40.890754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5b85431a-d1ae-4089-b485-9d6c79153cc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1575 microversion: 2.1 time: 0.255375 Sep 08 14:12:40.891355 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 549/1097] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:40 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:41.506407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37da3ae-5171-4ee2-9574-5de3021c2ef9", "name": "network-vif-deleted", "tag": "1e03d08d-9de5-40da-b09e-cdf6ce4f29c4"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:41.519160 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:41.519919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:41.520645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:41.533423 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] Creating event network-vif-deleted:1e03d08d-9de5-40da-b09e-cdf6ce4f29c4 for instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 on hv-cinder-85646 Sep 08 14:12:41.539042 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-567a301f-48c8-4833-8a87-ee65490144b2 req-242306bc-27da-4a7a-bde4-cdabfc5d41f0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Sep 08 14:12:41.540187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 549/1098] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:41.922274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:41.923435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:41.936932 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:41.937687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:41.938283 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:41.939191 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:41.939820 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:41.940434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.071293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:42.081736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b84df6ee-49c4-4cc3-811c-00aa13af15d0 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1224 microversion: 2.1 time: 0.164236 Sep 08 14:12:42.082806 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 550/1099] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:41 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1224 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:43.110216 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:43.111779 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:43.121795 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.123086 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.123800 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.124770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.125297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.125804 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.168232 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:43.169113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:43.169620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:43.170136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.objects.instance [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lazy-loading 'fault' on Instance uuid e37da3ae-5171-4ee2-9574-5de3021c2ef9 {{(pid=128400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:43.221260 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:43.232797 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e140d07f-096f-4b98-97b7-fd37116dafb6 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 200 len: 1229 microversion: 2.1 time: 0.127381 Sep 08 14:12:43.240187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 550/1100] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:43 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:44.266655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:44.267275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: e37da3ae-5171-4ee2-9574-5de3021c2ef9] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:44.275141 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:44.276046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:44.276709 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:44.277422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:44.278261 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:44.278702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:44.295642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] HTTP exception thrown: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Request method failure captured: Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 HTTP/1.1 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfZpqZqs1N7HMlfVrNpgCNt_OXDZMpRpqbbR6dp0zm9H-4ZTgIAOrfjyiMYNeoef3DiAt7HKsdD-hQ_sWKJOLW7NBLQKznZ5L_0m1lAOMzw4W20XfWcZ25-IUac_6JGBMF8G6gOYd0K-kEkPUynsPE_9ZKDycQ0sspdd2MwXokXokRI Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:12:44.297387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ae31829bffd7483fbab3dc87635aea58", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 26aa79753d6e4e49ad66cc32ba786fe8 Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. Sep 08 14:12:44.298889 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'e37da3ae-5171-4ee2-9574-5de3021c2ef9'} Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:12:44.299700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. Sep 08 14:12:44.301074 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:12:44.303450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Returning 404 to user: Instance e37da3ae-5171-4ee2-9574-5de3021c2ef9 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:12:44.304349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-22cfee04-044f-4440-b2ec-75dc3c8d171a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9" status: 404 len: 111 microversion: 2.1 time: 0.042616 Sep 08 14:12:44.304935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 551/1101] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:44 2022] GET /compute/v2.1/servers/e37da3ae-5171-4ee2-9574-5de3021c2ef9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:45.481294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:45.481893 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:45.488258 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:45.488749 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:45.489188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:45.489909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:45.490370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:45.490825 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:45.515367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6610257f-01bc-474c-acd4-f1899c589238 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/ips" status: 200 len: 151 microversion: 2.20 time: 0.038413 Sep 08 14:12:45.516025 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 551/1102] 10.222.0.97 () {60 vars in 1289 bytes} [Thu Sep 8 14:12:45 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:12:48.783423 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:48.784775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:48.790365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.790842 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.791274 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.791955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.792941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.793363 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.817728 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lazy-loading 'flavor' on Instance uuid cf6b1f56-d487-4959-80b9-9d0de157c020 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:49.642743 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8a7d9052-5e1c-4a90-b8b1-ef3073a5f7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/action" status: 202 len: 0 microversion: 2.20 time: 0.863157 Sep 08 14:12:49.643331 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 552/1103] 10.222.0.97 () {62 vars in 1319 bytes} [Thu Sep 8 14:12:48 2022] POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:12:49.651682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:49.652450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:49.660608 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:49.661201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:49.661721 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.662532 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:49.663066 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:49.663787 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.803718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:49.812528 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:49.813912 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:49.815094 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e1e1bf13-a49f-469b-9fad-e5c9df33fae9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.167476 Sep 08 14:12:49.815736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 552/1104] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:49 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:50.095600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:50.096210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:50.098388 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084bd4fc-4a10-484c-88ff-10c94f46b7ea", "tag": "eb033f6b-f0b8-45fb-be20-a16573012b2c"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:50.102528 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.103012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.103692 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.104708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.105284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.105787 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.108991 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.110603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.110603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.122174 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] Creating event network-changed:eb033f6b-f0b8-45fb-be20-a16573012b2c for instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea on hv-cinder-85646 Sep 08 14:12:50.127781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-a478dad4-0f5f-4378-a35e-dcf8bb28a0de req-ed34e2a5-310b-4dc7-aecf-b705ffac33a5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Sep 08 14:12:50.128611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 553/1105] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:50.133580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:12:50.460365 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8b5ada6e-4a65-481a-b812-03bc25965dc2 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "DELETE /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 204 len: 0 microversion: 2.1 time: 0.369138 Sep 08 14:12:50.461069 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 553/1106] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:12:50 2022] DELETE /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:12:50.470808 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:50.471557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:50.478132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.478614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.479051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.479742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.480259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.480735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.631285 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:50.641302 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-09388d79-f7e3-402a-9378-ccf954d76626 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.174600 Sep 08 14:12:50.642372 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 554/1107] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:50 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:50.841668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:50.842368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:50.848445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.848930 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.849367 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.850065 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.850514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.850936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.995730 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.004572 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.006019 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.007215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-75b10f04-4f7f-4a09-b641-28531aa9759b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.170091 Sep 08 14:12:51.007784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 554/1108] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:50 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:51.665661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:51.666613 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:51.673212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.673692 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.674125 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.674855 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.675320 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.675745 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.810192 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.818346 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4f352a93-7857-4dbd-9aaf-35546103f108 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.156837 Sep 08 14:12:51.819191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 555/1109] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:51 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:52.033162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:52.033877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:52.040915 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.041404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.041851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.043174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.043639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.044110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.184401 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:52.193109 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:52.194931 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:52.196162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4f43880e-9476-4754-ae71-3a124315fb13 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.167122 Sep 08 14:12:52.196734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 555/1110] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:52 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:52.842158 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:52.843000 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:52.849477 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.849976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.850404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.851105 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.859686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.859686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.032967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.041044 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dc115b7c-0996-479e-b215-1cf9f9680216 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.203026 Sep 08 14:12:53.041616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 556/1111] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:52 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:53.222445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:53.223028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:53.229609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:53.230106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:53.230545 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.231784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:53.231784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:53.232099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.399464 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.408290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.409905 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.411166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7d3506ce-abf1-4bc3-8a47-eb0b5e8e6391 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.192810 Sep 08 14:12:53.411882 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 556/1112] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:53 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:54.064771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:54.065400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:54.072437 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.072885 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.073856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.074567 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.075028 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.075456 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.214976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.223321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-92418b86-40d0-4401-82e5-fd657b634f4e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.162413 Sep 08 14:12:54.225841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 557/1113] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:54 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:54.439051 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:54.439679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:54.446481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.446942 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.447384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.448939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.449782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.450230 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.585023 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.594033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.595481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.596684 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-c0f18f51-43d9-4c7f-95ff-e6466ce831cd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.161947 Sep 08 14:12:54.597244 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 557/1114] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:54 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:55.247089 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:55.247806 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:55.255015 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.259884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.259884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.259884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.259884 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.260658 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.397005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:55.406856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2b98905a-3ace-4841-80ef-2b952b14fc0a tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.163640 Sep 08 14:12:55.407624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 558/1115] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:55 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:55.622836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:55.623557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:55.630387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.630874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.631434 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.632136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.632627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.636580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.769668 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:55.773255 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:55.778312 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:55.779757 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:55.780973 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4978d4ae-eeff-4d84-b50b-0c052de72d5d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.162239 Sep 08 14:12:55.781554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 558/1116] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:55 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:12:56.430937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:56.431576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:56.438101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.443784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.443784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.443784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.443784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.444191 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.579157 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.587135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-606b9448-30f2-4ec0-bf79-5e62ead1740f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.160163 Sep 08 14:12:56.587713 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 559/1117] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:56 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:56.808239 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:56.808870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:56.816185 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.818976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.818976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.818976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.818976 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.819449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.977260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.978371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.980666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.982154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-82bff39b-afaf-42b2-b2e0-1e5409277abb tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.178535 Sep 08 14:12:56.982751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 559/1118] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:56 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:57.611461 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:57.612128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:57.619226 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.620188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.620878 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.621753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.622368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.622957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.819256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:57.828958 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e56e85cc-d415-4373-b435-3ab3776db7b1 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1577 microversion: 2.1 time: 0.221414 Sep 08 14:12:57.830208 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 560/1119] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:57 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:57.926475 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084bd4fc-4a10-484c-88ff-10c94f46b7ea", "name": "network-vif-deleted", "tag": "eb033f6b-f0b8-45fb-be20-a16573012b2c"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:57.938229 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:57.938759 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:57.939204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:57.951589 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] Creating event network-vif-deleted:eb033f6b-f0b8-45fb-be20-a16573012b2c for instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea on hv-cinder-85646 Sep 08 14:12:57.957032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-8566d298-a6d4-4cdd-8645-669f4e03159f req-dbc3d930-bab5-4489-8a3b-96db39db5d34 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037189 Sep 08 14:12:57.957622 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 560/1120] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:58.008660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:58.009274 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:58.015913 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.016433 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.016870 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.017564 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.018021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.018450 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.184654 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:58.186693 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:58.187463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:58.188712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b3c5a5cf-1bf7-4247-bedd-07652d80f467 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.184026 Sep 08 14:12:58.189279 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 561/1121] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:58 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:58.854450 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:58.855192 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:58.862060 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.862560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.862996 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.863708 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.864205 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.864615 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.897361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.897840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.898275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.898716 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lazy-loading 'fault' on Instance uuid 084bd4fc-4a10-484c-88ff-10c94f46b7ea {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:58.942112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26aa79753d6e4e49ad66cc32ba786fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae31829bffd7483fbab3dc87635aea58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:58.952314 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a6f0ee85-102a-4a5e-9d9e-d6f31514391e tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 200 len: 1229 microversion: 2.1 time: 0.102329 Sep 08 14:12:58.952901 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 561/1122] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:58 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:59.231561 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:59.232188 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:59.238770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.239259 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.239698 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:59.240476 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.240935 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.241364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:59.384494 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:59.393172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:59.394620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:59.395812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-dd1f9c7d-1d20-42b3-9b5d-68e714d7fbdd tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.168823 Sep 08 14:12:59.396416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 562/1123] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:12:59 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:12:59.975070 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:59.976850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: 084bd4fc-4a10-484c-88ff-10c94f46b7ea] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:59.986576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.986576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.986576 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:59.987217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:59.988066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:59.989004 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.003941 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] HTTP exception thrown: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Request method failure captured: Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea HTTP/1.1 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfZpqZqs1N7HMlfVrNpgCNt_OXDZMpRpqbbR6dp0zm9H-4ZTgIAOrfjyiMYNeoef3DiAt7HKsdD-hQ_sWKJOLW7NBLQKznZ5L_0m1lAOMzw4W20XfWcZ25-IUac_6JGBMF8G6gOYd0K-kEkPUynsPE_9ZKDycQ0sspdd2MwXokXokRI Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:13:00.005699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ae31829bffd7483fbab3dc87635aea58", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 26aa79753d6e4e49ad66cc32ba786fe8 Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. Sep 08 14:13:00.007347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '084bd4fc-4a10-484c-88ff-10c94f46b7ea'} Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:13:00.008285 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. Sep 08 14:13:00.009722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.012591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Returning 404 to user: Instance 084bd4fc-4a10-484c-88ff-10c94f46b7ea could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:13:00.013600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-461ed209-eae6-47ba-b2f9-703a5193c576 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea" status: 404 len: 111 microversion: 2.1 time: 0.042568 Sep 08 14:13:00.016177 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 562/1124] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:59 2022] GET /compute/v2.1/servers/084bd4fc-4a10-484c-88ff-10c94f46b7ea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:00.422513 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:00.423037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:00.429910 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.432135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.432135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.432135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.432963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.433340 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.437738 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:00.574013 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:00.582562 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:00.584111 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:00.585375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cd968318-daa8-435e-bf63-39de7d60bd8f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.166970 Sep 08 14:13:00.586016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 563/1125] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:00 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:00.617852 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:00.618364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:00.625366 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.625856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.626297 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.627007 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.627496 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.627923 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.643751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] HTTP exception thrown: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Request method failure captured: Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab HTTP/1.1 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfZpqZqs1N7HMlfVrNpgCNt_OXDZMpRpqbbR6dp0zm9H-4ZTgIAOrfjyiMYNeoef3DiAt7HKsdD-hQ_sWKJOLW7NBLQKznZ5L_0m1lAOMzw4W20XfWcZ25-IUac_6JGBMF8G6gOYd0K-kEkPUynsPE_9ZKDycQ0sspdd2MwXokXokRI Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:13:00.645430 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ae31829bffd7483fbab3dc87635aea58", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: 26aa79753d6e4e49ad66cc32ba786fe8 Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.647099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'fa4be2d8-2899-4377-850f-21ed875432ab'} Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:13:00.648046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.649580 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.651526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Returning 404 to user: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:13:00.651526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2a849e03-4cc6-4658-831e-233f7b27c64f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "DELETE /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 404 len: 111 microversion: 2.1 time: 0.033026 Sep 08 14:13:00.651526 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 563/1126] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:13:00 2022] DELETE /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:00.661512 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:00.662121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] [instance: fa4be2d8-2899-4377-850f-21ed875432ab] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:00.668770 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.669271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.669724 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.670427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:00.670882 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:00.671377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:00.686051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] HTTP exception thrown: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Request method failure captured: Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab HTTP/1.1 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfZpqZqs1N7HMlfVrNpgCNt_OXDZMpRpqbbR6dp0zm9H-4ZTgIAOrfjyiMYNeoef3DiAt7HKsdD-hQ_sWKJOLW7NBLQKznZ5L_0m1lAOMzw4W20XfWcZ25-IUac_6JGBMF8G6gOYd0K-kEkPUynsPE_9ZKDycQ0sspdd2MwXokXokRI Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:13:00.687637 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ae31829bffd7483fbab3dc87635aea58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ae31829bffd7483fbab3dc87635aea58", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: ae31829bffd7483fbab3dc87635aea58 Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-TestVolumeBootPattern-1166381998 Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: 26aa79753d6e4e49ad66cc32ba786fe8 Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-TestVolumeBootPattern-1166381998-project Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.689303 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'fa4be2d8-2899-4377-850f-21ed875432ab'} Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:13:00.690236 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. Sep 08 14:13:00.691736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:13:00.693070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Returning 404 to user: Instance fa4be2d8-2899-4377-850f-21ed875432ab could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:13:00.693070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-a312f442-fd7d-496f-899a-b6d3e08d669f tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab" status: 404 len: 111 microversion: 2.1 time: 0.031522 Sep 08 14:13:00.693070 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 564/1127] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:00 2022] GET /compute/v2.1/servers/fa4be2d8-2899-4377-850f-21ed875432ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:01.211089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:01.217171 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:01.220600 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:01.221238 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:01.221824 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:01.222646 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:01.223340 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:01.223959 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:01.315509 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lazy-loading 'services' on Instance uuid 4318d52b-b2a3-4c02-a43a-84984ad95d1f {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:13:01.611620 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:01.612328 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:01.619391 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:01.619936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:01.620927 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:01.621653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:01.622117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:01.622549 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:01.642480 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-03975101-d13c-4f16-aa78-1afeb5d2fbb7 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "DELETE /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f/os-volume_attachments/903480cd-1d12-4aef-8bcd-cbdd33a9c5df" status: 202 len: 0 microversion: 2.1 time: 0.438702 Sep 08 14:13:01.643292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 564/1128] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:13:01 2022] DELETE /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f/os-volume_attachments/903480cd-1d12-4aef-8bcd-cbdd33a9c5df => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:13:01.768079 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:01.776945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:01.778529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:01.779718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1111a7fc-e046-425c-821f-ca2fe518e64a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.172536 Sep 08 14:13:01.780298 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 565/1129] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:01 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:02.454505 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-7c92eeff-79bc-44f1-9a92-9ffe7a028a71 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] Calling method '.version_select at 0x7f7f8aef2c10>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:02.462419 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:02.736387 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7c92eeff-79bc-44f1-9a92-9ffe7a028a71 tempest-TestVolumeBootPattern-1166381998 tempest-TestVolumeBootPattern-1166381998-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-23972180" status: 202 len: 0 microversion: 2.1 time: 0.286788 Sep 08 14:13:02.736990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 565/1130] 10.222.0.97 () {58 vars in 1257 bytes} [Thu Sep 8 14:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-23972180 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:13:02.806004 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:02.806625 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:02.814263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:02.814755 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:02.815205 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:02.815909 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:02.816403 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:02.816837 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:03.009397 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:03.018122 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:03.019752 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:03.022173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c137d7c9-1f77-4ec7-84ff-92a00ade1d1c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.220049 Sep 08 14:13:03.022945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 566/1131] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:02 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:03.849573 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:03.850130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:03.857068 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:03.857554 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:03.858017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:03.858703 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:03.859165 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:03.859624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:03.884110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Going to try to terminate instance {{(pid=128401) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:13:04.048336 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:04.049115 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:04.056123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:04.056639 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:04.057112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:04.058404 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:04.059020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:04.059600 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:04.322655 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:04.331946 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:04.333458 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:04.334701 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6c218dbb-8fac-45da-9b50-988ed0b40a0f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.290374 Sep 08 14:13:04.335194 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 567/1132] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:04 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:04.352003 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a5098d6c-27e9-4b1f-8112-81ab305cd00c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "DELETE /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 204 len: 0 microversion: 2.1 time: 0.506960 Sep 08 14:13:04.352865 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 566/1133] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:13:03 2022] DELETE /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:13:04.362045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:04.363179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:04.369673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:04.370736 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:04.371178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:04.371901 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:04.372400 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:04.372831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:04.796100 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:04.800560 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b1f99aa4-58e0-4847-b559-dbf25d4e6d05 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1514 microversion: 2.1 time: 0.442575 Sep 08 14:13:04.801348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 568/1134] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:04 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:05.361686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:05.362517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:05.369683 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:05.370766 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:05.371210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:05.372041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:05.372634 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:05.373033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:05.513278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:05.521848 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:05.523332 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:05.524553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-12263cc8-2a13-48f6-b193-7c29ed47a48d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.167279 Sep 08 14:13:05.525123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 567/1135] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:05 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:05.826113 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:05.826641 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:05.833603 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:05.834088 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:05.834571 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:05.835314 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:05.835778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:05.836262 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:05.972426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:05.981126 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-61112d07-e2d6-471d-8891-c0e8f300652e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1514 microversion: 2.1 time: 0.159741 Sep 08 14:13:05.981711 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 569/1136] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:05 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:06.550429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:06.551790 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:06.558827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:06.559560 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:06.560284 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:06.561121 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:06.561682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:06.562186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:06.736877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:06.767456 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:06.769211 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:06.770629 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d0d12f97-8851-412e-b294-4119dc82cfbc tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.224504 Sep 08 14:13:06.775697 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 568/1137] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:06 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:07.005536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:07.006719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:07.010945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:13:07.011489 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Thu Sep 8 14:13:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f (ip 10.222.0.97) !!! Sep 08 14:13:07.019353 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:07.020021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:07.020645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:07.021495 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:07.022110 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:07.022914 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:07.197136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:07.214382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8b96ce1e-d274-4b1f-b64e-33ff25548417 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1514 microversion: 2.1 time: 0.212344 Sep 08 14:13:07.223640 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 570/1138] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:07 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:07.299260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4318d52b-b2a3-4c02-a43a-84984ad95d1f", "name": "network-vif-deleted", "tag": "2c4518dd-915b-4338-bcf5-9033afa4cefa"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:07.309371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:07.309936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:07.310493 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:07.323608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] Creating event network-vif-deleted:2c4518dd-915b-4338-bcf5-9033afa4cefa for instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f on hv-cinder-85646 Sep 08 14:13:07.328741 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-96491d78-cdad-4c27-b3ec-c72d25b8f7e3 req-477f3064-3c7c-4784-967c-bca0fa434ea3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Sep 08 14:13:07.329348 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 569/1139] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:07.796505 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:07.797277 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:07.799333 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:07.804017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:07.804537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:07.804977 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:07.805673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:07.806128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:07.806660 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:07.946838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:07.956068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:07.957704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:07.959059 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-c1f991c1-b21e-4ac1-bcd5-4abdeb3a805f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1743 microversion: 2.20 time: 0.166693 Sep 08 14:13:07.959742 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 571/1140] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:07 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:08.241035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:08.241591 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:08.251304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:08.251907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:08.252515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:08.253515 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:08.253985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:08.254570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:08.295502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:08.296016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:08.296834 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:08.297309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lazy-loading 'fault' on Instance uuid 4318d52b-b2a3-4c02-a43a-84984ad95d1f {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:13:08.351409 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:08.360336 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-73505392-3868-4940-98aa-0e245ab27a33 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 200 len: 1308 microversion: 2.1 time: 0.124855 Sep 08 14:13:08.361041 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 570/1141] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:08 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:08.985688 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:08.986459 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:08.993832 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:08.994421 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:08.995778 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:08.996904 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:08.997370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:08.997803 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:09.144326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:09.153861 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:09.155311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:09.156610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e7c00d6e-c5a5-44e0-ac11-58a7a0b77ddf tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1743 microversion: 2.20 time: 0.174711 Sep 08 14:13:09.157184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 572/1142] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:08 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:09.387216 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:09.387829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: 4318d52b-b2a3-4c02-a43a-84984ad95d1f] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:09.394582 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:09.395066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:09.395504 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:09.396234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:09.396688 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:09.397113 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:09.411122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] HTTP exception thrown: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Request method failure captured: Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f HTTP/1.1 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfgk9rZ05gpNG888LnJB7in8mwOeHlbq0UodMlyIB7f4w_KzuExM_jyLORe6OJeGJPrML_Kjzu1NmOeQt18mWBvx3epM_Pm1ZLIpzXCSDGqp0IXXf3SSy3T5K2ZjtMV7M9ltKjWImNtZ1JkATIyZaeHH7pkDt5WYGlVWl8gJbussv_A Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: d3cad599cd5943e8b545de7bacca6fe1 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:13:09.412869 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_d3cad599cd5943e8b545de7bacca6fe1", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: d3cad599cd5943e8b545de7bacca6fe1 Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesSnapshotTestJSON-2141585415-project Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: ae8540a6f24149abbab456ca1c6b33c7 Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesSnapshotTestJSON-2141585415-project Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. Sep 08 14:13:09.414275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': '4318d52b-b2a3-4c02-a43a-84984ad95d1f'} Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:13:09.415096 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. Sep 08 14:13:09.416425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:13:09.418364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Returning 404 to user: Instance 4318d52b-b2a3-4c02-a43a-84984ad95d1f could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:13:09.418364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d4044caf-798f-4017-be10-039b91f11ad9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f" status: 404 len: 111 microversion: 2.1 time: 0.031795 Sep 08 14:13:09.418364 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 571/1143] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:09 2022] GET /compute/v2.1/servers/4318d52b-b2a3-4c02-a43a-84984ad95d1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:10.190488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:10.190488 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:10.191817 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:10.192335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:10.193027 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:10.194210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:10.195856 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:10.196558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:10.361811 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:10.370210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:10.372653 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:10.373962 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fb37295d-f599-47fa-942f-614299fb8b39 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.194327 Sep 08 14:13:10.374845 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 573/1144] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:10 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:11.403006 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:11.403639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:11.417321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:11.418106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:11.420361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:11.421111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:11.421605 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:11.422044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:11.633816 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:11.643173 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:11.644751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:11.647603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da5266e0-acb6-4e46-bf4c-fce45147d464 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.249652 Sep 08 14:13:11.648602 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 572/1145] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:11 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:12.675955 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:12.676575 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:12.686299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:12.691063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:12.691843 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:12.693399 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:12.694558 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:12.696748 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:12.905483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:12.916322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:12.918726 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:12.920356 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-bbe22b6c-af22-4116-8fb3-2581600b07e7 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.249569 Sep 08 14:13:12.928771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 574/1146] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:12 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:13.516637 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "name": "network-vif-plugged", "status": "completed", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:13.552262 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:13.552960 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:13.553522 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:13.569570 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] Creating event network-vif-plugged:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:13:13.576829 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-20bef225-85a8-4fb3-a259-50bf71501476 req-da0d7351-24e8-4a11-8863-892dc7003c60 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219813 Sep 08 14:13:13.577946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 573/1147] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:13.952784 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:13.954108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:13.961972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:13.962500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:13.962954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:13.964419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:13.965138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:13.965796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:14.111714 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:14.123299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:14.125329 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:14.126879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9af9296d-3558-4b8c-9f4b-24cce90d7679 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.183448 Sep 08 14:13:14.127583 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 575/1148] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:13 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:15.155351 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:15.156201 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:15.163594 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:15.164081 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:15.164875 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:15.165750 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:15.166446 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:15.167021 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:15.328226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:15.339686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:15.341393 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:15.342817 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-84b3409e-ec1e-42e1-a077-2688feaf6b9a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.193661 Sep 08 14:13:15.343378 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 574/1149] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:15 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:16.368718 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:16.370257 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:16.377407 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:16.378224 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:16.378852 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:16.379919 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:16.380429 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:16.380872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:16.581382 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:16.591449 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:16.593354 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:16.594649 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e310d8a1-5583-443b-a1d6-1f91a344e716 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.229845 Sep 08 14:13:16.595290 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 576/1150] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:16 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:17.622464 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:17.623181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:17.629955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:17.630771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:17.631210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:17.631918 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:17.632626 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:17.633105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:17.806353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:17.817428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:17.819292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:17.820585 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-00d6b5fe-512c-43d8-9093-d66843e4d0c6 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.202950 Sep 08 14:13:17.821184 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 575/1151] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:17 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:19.142763 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:19.144982 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:19.153864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:19.154629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:19.154989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:19.155719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:19.156210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:19.156647 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:19.318516 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:19.332716 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:19.334178 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:19.335364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-8f8e9e4d-bd33-486e-9f6d-e390cfc6612a tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.489571 Sep 08 14:13:19.336112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 577/1152] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:18 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:20.361136 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:20.361746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:20.368304 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:20.368784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:20.369215 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:20.370523 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:20.370977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:20.371449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:20.505624 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:20.513910 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:20.515374 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:20.516584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a7c90e22-01bd-41ce-afae-dca2662d31ed tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.159482 Sep 08 14:13:20.517153 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 576/1153] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:20 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:20.734709 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1264487880", "imageRef": "efc4ec9d-2060-4289-8517-c48730d41f53", "flavorRef": "452", "networks": [{"uuid": "edcff5a5-b489-4160-904f-0b970dd89303"}]}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:20.796248 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.network.neutron [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] validate_networks() for [('edcff5a5-b489-4160-904f-0b970dd89303', None, None, None, None, None)] {{(pid=128400) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:13:21.186646 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Flavor limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:13:21.187075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Image limits 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:13:21.187598 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Flavor pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:13:21.187976 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Image pref 0:0:0 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:13:21.188427 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.virt.hardware [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:13:21.198297 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:21.198772 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:21.199201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:21.199918 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:21.200415 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:21.200835 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:21.218886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Getting quotas for project d3cad599cd5943e8b545de7bacca6fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:13:21.223043 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.quota [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Getting quotas for user ae8540a6f24149abbab456ca1c6b33c7 and project d3cad599cd5943e8b545de7bacca6fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=128400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:13:21.234247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Going to run 1 instances... {{(pid=128400) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:13:21.236624 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='efc4ec9d-2060-4289-8517-c48730d41f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:13:21.445515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e28f1f1a-d4c0-4733-9aa0-29cea854beb6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715250 Sep 08 14:13:21.446416 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 578/1154] 10.222.0.97 () {60 vars in 1147 bytes} [Thu Sep 8 14:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:13:21.457647 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-da0f4910-cc5f-4880-8a60-d5510ec5f261 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:21.458353 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-da0f4910-cc5f-4880-8a60-d5510ec5f261 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:21.518734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-da0f4910-cc5f-4880-8a60-d5510ec5f261 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:21.526449 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-da0f4910-cc5f-4880-8a60-d5510ec5f261 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1219 microversion: 2.1 time: 0.072790 Sep 08 14:13:21.527635 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 577/1155] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:21 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:21.543920 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:21.544754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:21.550812 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:21.551515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:21.551957 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:21.552690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:21.553180 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:21.553611 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:21.698629 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:21.707166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:21.708651 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:21.709838 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d5a7217f-6d94-42b5-9a24-9fc738606221 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1738 microversion: 2.20 time: 0.171021 Sep 08 14:13:21.710464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 579/1156] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:21 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:22.548984 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-60aef24b-5475-418b-8802-69523f8d8d88 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:22.549613 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-60aef24b-5475-418b-8802-69523f8d8d88 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:22.604473 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-60aef24b-5475-418b-8802-69523f8d8d88 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:22.611483 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-60aef24b-5475-418b-8802-69523f8d8d88 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1219 microversion: 2.1 time: 0.066350 Sep 08 14:13:22.612052 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 578/1157] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:22 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:22.735627 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:22.736293 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:22.742796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:22.743288 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:22.743722 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:22.744448 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:22.745003 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:22.745434 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:22.882972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:22.891500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:22.893034 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:22.894212 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ed8fd3c3-2128-4a3b-968d-c446f531d607 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1720 microversion: 2.20 time: 0.162588 Sep 08 14:13:22.894771 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 580/1158] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:22 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:23.634067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:23.634659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:23.641291 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:23.641767 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:23.642200 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:23.642885 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:23.643334 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:23.643755 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:23.662217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:23.708903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:23.717104 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4bc79b5a-4ad7-4554-afa5-369c076061bb tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1215 microversion: 2.1 time: 0.086925 Sep 08 14:13:23.717679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 579/1159] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:23 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:23.921039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:23.921574 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:23.928091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:23.928609 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:23.929046 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:23.929758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:23.930195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:23.930685 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:23.935249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=100 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:24.067565 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:24.072136 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:24.073709 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:24.074875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5dceaf84-77f6-4fe3-bea2-1c45c2a44532 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1720 microversion: 2.20 time: 0.158591 Sep 08 14:13:24.075442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 581/1160] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:23 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:24.741689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:24.742306 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:24.749792 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:24.750282 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:24.750722 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:24.751428 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:24.751890 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:24.752358 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:24.817627 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:24.825989 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-b833a7f3-d5d6-4921-937a-0db6892f17bd tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1215 microversion: 2.1 time: 0.088678 Sep 08 14:13:24.826642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 580/1161] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:24 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:25.100273 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:25.100883 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:25.107589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:25.108074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:25.108543 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:25.109241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:25.109704 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:25.110164 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:25.251998 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:25.260442 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:25.261842 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:25.263135 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-69b82a4e-ca73-4495-9821-48dfde247662 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1720 microversion: 2.20 time: 0.166860 Sep 08 14:13:25.263689 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 582/1162] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:25 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:25.279451 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:25.290147 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:25.290631 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:25.292045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:25.302764 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] Creating event network-vif-unplugged:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:13:25.307878 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-cfcf8920-bfb0-41d4-9bb9-096be76280d9 req-abf08ce7-681e-4778-9ee6-fcd624d0ca71 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033640 Sep 08 14:13:25.308563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 581/1163] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:25.849359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:25.849968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:25.855872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:25.856385 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:25.856809 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:25.857518 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:25.857967 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:25.858384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:25.920121 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:25.927903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7ef119e1-75d3-449e-9908-dd9049481fe6 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1279 microversion: 2.1 time: 0.083012 Sep 08 14:13:25.928515 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 583/1164] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:25 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:26.290278 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:26.291154 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:26.297273 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.303029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.303029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:26.303029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.303029 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.303459 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:26.445985 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:26.454975 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:26.456481 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:26.457871 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2d6d7b5c-86d6-44f8-8eda-1701959e4f67 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1663 microversion: 2.20 time: 0.172494 Sep 08 14:13:26.458432 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 582/1165] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:26 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:26.483566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f616eea7-a493-433d-851c-35c1eb95a8c7"}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:26.486753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:26.495499 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.495990 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.496480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:26.499879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.499879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.499879 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:26.950958 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:26.951597 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:26.958234 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.958723 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.959153 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:26.960287 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:26.960746 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:26.961315 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:27.099067 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:27.102395 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9a58bb9f-3921-4e90-9277-33fb7e1407c9 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.155267 Sep 08 14:13:27.102965 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 583/1166] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:26 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:13:28.107477 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d33920-d247-427b-bc5d-8def031bda80", "tag": "08ecd00f-e343-476e-8046-709ba24684d8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:28.122235 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:28.122880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:28.123398 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:28.136110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] Creating event network-changed:08ecd00f-e343-476e-8046-709ba24684d8 for instance e6d33920-d247-427b-bc5d-8def031bda80 on hv-cinder-85646 Sep 08 14:13:28.141075 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-56fa26c3-7d09-4de9-b361-faa9784f37c8 req-3023318c-1a66-4448-a03f-93aa93a22b1d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037274 Sep 08 14:13:28.141868 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 584/1167] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:13:28.146978 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:28.147689 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:28.154101 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:28.157821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:28.157821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:28.157821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:28.157821 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:28.158309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:28.195367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2d8bf8c3-adcf-476b-9135-3f5978538bab tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.716034 Sep 08 14:13:28.198309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 584/1168] 10.222.0.97 () {62 vars in 1364 bytes} [Thu Sep 8 14:13:26 2022] POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments => generated 188 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:13:28.302403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:28.312566 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ed077eb0-2eae-49ba-8352-a2e40e78c6e2 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.169451 Sep 08 14:13:28.313275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 585/1169] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:28 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:28.340557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:28.341058 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:28.347120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:28.347610 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:28.348383 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:28.349284 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:28.349576 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:28.349966 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.327068 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-22bd0c12-aad3-461e-b481-db771273e4f0 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments/f616eea7-a493-433d-851c-35c1eb95a8c7" status: 202 len: 0 microversion: 2.20 time: 0.990605 Sep 08 14:13:29.327737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 585/1170] 10.222.0.97 () {60 vars in 1457 bytes} [Thu Sep 8 14:13:28 2022] DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments/f616eea7-a493-433d-851c-35c1eb95a8c7 => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:13:29.341617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:29.342321 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:29.348900 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.349392 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.349836 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.350546 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.351008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.351470 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.392820 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:29.393432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:29.399659 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.400377 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.401291 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.402008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.402470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.403401 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.489368 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:29.497781 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-dd778fe8-e676-48f5-8c76-5b5e2a3aba4c tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.160661 Sep 08 14:13:29.498370 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 586/1171] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:29 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:29.554063 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128400) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:13:29.958309 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b4c9753b-e995-4202-a11a-dddee340b890 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/action" status: 202 len: 0 microversion: 2.20 time: 0.569440 Sep 08 14:13:29.959138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 586/1172] 10.222.0.97 () {62 vars in 1319 bytes} [Thu Sep 8 14:13:29 2022] POST /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:13:29.967863 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:29.968507 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:29.975011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.975499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.975939 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:29.976681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:29.977138 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:29.977564 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:30.116405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:30.126680 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:30.128435 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:30.129874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-44a8db03-5983-42c2-99d8-7868161d0830 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1671 microversion: 2.20 time: 0.166035 Sep 08 14:13:30.130963 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 587/1173] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:29 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:30.522492 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:30.523064 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:30.530650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:30.531138 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:30.531712 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:30.532669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:30.533359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:30.533936 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:30.707570 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:30.716287 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-cc938ae3-5c5e-45c7-8ff0-fdab0d1c400b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.198322 Sep 08 14:13:30.717019 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 587/1174] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:30 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:31.159090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:31.159782 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:31.167126 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.167609 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.168047 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.168772 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.169231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.169657 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.316008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:31.325491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:31.327418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:31.328275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-80303ceb-2d98-46dd-b487-ef96b4d13986 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1671 microversion: 2.20 time: 0.173199 Sep 08 14:13:31.328850 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 588/1175] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:31 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:31.738989 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:31.739631 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:31.741529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=2 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.742283 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell0:SELECT=6 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.747703 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.748253 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.748686 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.749393 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.749822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.750241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.883359 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:31.890988 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-ccef6f1b-ac16-4d41-985f-12b126f07959 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.155921 Sep 08 14:13:31.891566 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 588/1176] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:31 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:32.354536 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:32.355220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:32.362524 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.362999 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.363439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:32.364163 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.364625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.365059 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:32.501406 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:32.509702 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:32.511143 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:32.513956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-04559eff-52a6-4678-9142-652d4761c95b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.162452 Sep 08 14:13:32.513956 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 589/1177] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:32 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:32.914983 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:32.915727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:32.923096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.923580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.924017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:32.924761 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.925278 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.925706 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:33.062294 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:33.070342 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4a42b7ae-2e6e-406f-9205-2d7a09feb25e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.159906 Sep 08 14:13:33.070917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 589/1178] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:32 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:33.537620 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:33.538242 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:33.540256 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell0:SELECT=4 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:33.545955 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:33.546442 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:33.546936 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:33.547774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:33.548261 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:33.548891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:33.684226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:33.692950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:33.694666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:33.697405 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-8d7aab91-4655-44ba-b848-0038267ec14e tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.163675 Sep 08 14:13:33.697990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 590/1179] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:33 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:34.095864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:34.095864 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:34.104753 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.105638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.106355 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.108169 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.108992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.110172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.282963 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:34.291979 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d78ceaee-6599-43ff-ba40-601d64bdd5b3 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.201265 Sep 08 14:13:34.304737 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 590/1180] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:34 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:34.723352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:34.724667 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:34.727231 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:34.732222 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.732707 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.733180 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.733912 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.734361 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.734780 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.878049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:34.886800 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:34.888269 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:34.889445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-d214ec1a-36e9-4730-80ea-5d835d886395 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.170419 Sep 08 14:13:34.890027 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 591/1181] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:34 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:35.318172 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:35.319730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:35.328040 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.328796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.329484 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.330537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.331319 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.332016 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.421686 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d33920-d247-427b-bc5d-8def031bda80", "name": "network-vif-plugged", "status": "completed", "tag": "08ecd00f-e343-476e-8046-709ba24684d8"}]} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:35.438512 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.442033 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.442861 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.459497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.compute.server_external_events [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] Creating event network-vif-plugged:08ecd00f-e343-476e-8046-709ba24684d8 for instance e6d33920-d247-427b-bc5d-8def031bda80 on hv-cinder-85646 Sep 08 14:13:35.474028 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [req-6be6883c-3257-4957-863c-d1f526e92b15 req-c102f6e1-6e5c-4f85-9f3c-d6b87b67aeee service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055910 Sep 08 14:13:35.474948 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 592/1182] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:13:35.542072 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:35.546751 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:35.557332 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3085f45d-3f3e-40e7-bdcd-ac9e40b7f732 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.242405 Sep 08 14:13:35.559091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 591/1183] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:35 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:35.916899 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:35.918844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:35.926123 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.926699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.927193 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.928561 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.929162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.929857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:36.088197 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:36.097376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:36.098933 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:36.100300 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-df77b3a2-9d41-40e8-b4af-dc693afc4e6d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.189491 Sep 08 14:13:36.101085 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 593/1184] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:35 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:36.583011 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:36.583580 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:36.591250 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:36.591730 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:36.592310 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:36.593021 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:36.593474 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:36.598915 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:36.745430 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:36.754334 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9efe678c-8faa-4952-bd1f-720d29ed6a70 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.175269 Sep 08 14:13:36.755241 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 592/1185] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:36 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:37.126404 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:37.127046 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:37.133581 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.134066 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.134507 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.135207 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.135666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.136097 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.289840 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:37.302682 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:37.304226 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:37.305422 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e23b4ec6-2363-4f4b-8b00-9a75925a1d09 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.182956 Sep 08 14:13:37.305992 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 594/1186] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:37 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:37.777075 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:37.800875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:37.800875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.800875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.800875 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.801370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.801370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.801370 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.947794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:37.955682 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-d5e82db1-a2e7-40fe-a922-b8f3b9360f5f tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.182579 Sep 08 14:13:37.956979 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 593/1187] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:37 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:38.373178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:38.373178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:38.373178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.373178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.374058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.374058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.374058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.374058 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.492611 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:38.502178 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:38.503625 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:38.504874 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-40437a3d-5a6c-482c-9b40-e17a48cc825b tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.175225 Sep 08 14:13:38.505457 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 595/1188] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:38 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:38.981219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:38.981877 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:38.989426 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.990020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.990462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.991182 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.992020 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.992465 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:39.140381 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:39.148997 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-fb3ccf23-5dc5-4142-b04a-0ae40e5de5d1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.172390 Sep 08 14:13:39.152184 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 594/1189] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:38 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:39.531199 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:39.531814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:39.538282 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:39.538808 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:39.539309 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:39.540008 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:39.540501 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:39.541517 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:39.691032 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:39.700880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:39.702219 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:39.703407 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-a5dd2440-c766-4340-8f77-46f9ab378871 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.176155 Sep 08 14:13:39.703977 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 596/1190] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:39 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:40.173271 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:40.173995 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:40.182074 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.182581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.183008 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.183720 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.184197 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.184632 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.328536 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:40.338396 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-34c25d88-a101-48e4-b206-0e51952c8542 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.168823 Sep 08 14:13:40.350322 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 595/1191] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:40 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:40.731870 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:40.733225 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:40.740110 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.741042 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.741734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.742788 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.743563 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.744290 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.895953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:40.905490 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:40.907112 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:40.908346 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3141f55b-b909-4d86-9640-2afc96c5a12c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.181175 Sep 08 14:13:40.908914 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 597/1192] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:40 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:41.367707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:41.369312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:41.371871 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:41.376707 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.381865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.381865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.381865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.381865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.382255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.528017 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:41.536872 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-48b4450f-9139-4aec-b7a6-99890632c86d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.173290 Sep 08 14:13:41.537460 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 596/1193] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:41 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:41.937245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:41.938642 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:41.946016 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.946925 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.947614 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.948608 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.949298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.950078 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.955063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=100 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:42.096538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:42.105590 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:42.107057 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:42.108360 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-0f207081-a238-45bc-8aa4-03f802aae919 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.175102 Sep 08 14:13:42.108935 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 598/1194] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:41 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:42.560432 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:42.561071 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:42.567894 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:42.568348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:42.569051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:42.569824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:42.570286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:42.570758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:42.704968 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:42.713445 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-1bb5b575-d1c7-42b4-95af-fa22eb8d2566 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.157840 Sep 08 14:13:42.714173 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 597/1195] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:42 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:43.136063 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:43.136778 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:43.143418 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:43.143907 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:43.144384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:43.145089 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:43.145552 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:43.145986 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:43.278770 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:43.287111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:43.288628 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:43.289797 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-fe6d6954-e61b-4f2e-97bc-03c2eca09e57 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.158780 Sep 08 14:13:43.290514 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 599/1196] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:43 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:43.737187 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:43.737799 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:43.745249 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:43.746007 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:43.746166 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:43.746858 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:43.747316 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:43.747741 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:43.876645 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:43.885200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f21c5286-6c5e-46a2-9c6f-6f1c03e1397d tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.151190 Sep 08 14:13:43.885776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 598/1197] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:43 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:44.315520 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:44.316397 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:44.323376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:44.323858 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:44.324329 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:44.325039 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:44.325491 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:44.325913 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:44.470260 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:44.479343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:44.480810 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:44.482099 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-cd9cf409-a338-4e15-ac1f-7e892e570590 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.170635 Sep 08 14:13:44.482891 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 600/1198] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:44 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:44.907127 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:44.907769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:44.914375 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:44.914854 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:44.915311 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:44.916037 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:44.916523 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:44.916951 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:45.044819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:45.053195 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-82007057-4405-4989-8600-a24410ac1812 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1319 microversion: 2.1 time: 0.150054 Sep 08 14:13:45.053765 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 599/1199] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:44 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:45.507425 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:45.508012 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:45.515851 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:45.516371 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:45.516856 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:45.517557 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:45.518018 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:45.518455 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:45.655603 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:45.663969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:45.665479 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:45.666671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-9cfab4b9-e9fb-4e49-9ca4-7d1724e50089 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.163321 Sep 08 14:13:45.667243 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 601/1200] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:45 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:46.075940 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:46.076661 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:46.083540 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.084406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.084846 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.085539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.086010 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.086500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.222155 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:46.230766 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b605ef6e-8d9a-4ea5-9401-12482e374a73 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1509 microversion: 2.1 time: 0.158770 Sep 08 14:13:46.231347 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 600/1201] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:46 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:46.254333 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4f1661-8218-45a0-a017-367e22ec279c", "device": "/dev/sdb"}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:46.256784 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:46.263725 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.264251 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.264700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.265413 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.266010 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.266301 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.692243 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:46.692764 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:46.699508 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.700005 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.700469 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.701317 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:46.701672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:46.702103 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:46.835831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:46.852638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:46.852638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:46.852638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-2454c457-7bfe-4354-8548-a1a8007fe893 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.158864 Sep 08 14:13:46.852993 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 601/1202] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:46 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:47.669323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-63a12c93-b624-4f41-abdb-b18c5d44449e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "POST /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418744 Sep 08 14:13:47.670174 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 602/1203] 10.222.0.97 () {60 vars in 1323 bytes} [Thu Sep 8 14:13:46 2022] POST /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80/os-volume_attachments => generated 194 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:47.872945 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:47.873638 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:47.880132 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:47.880679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:47.881120 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:47.881822 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:47.882306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:47.882745 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:48.021124 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:48.029312 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:48.030739 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:48.031890 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-16c974f2-751f-465e-a1b3-78d79ddde2b9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.163739 Sep 08 14:13:48.032483 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 602/1204] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:47 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:49.059700 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:49.060319 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:49.066739 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:49.067245 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:49.067671 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:49.068482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:49.069206 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:49.069636 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:49.201814 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:49.210323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:49.211789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:49.213610 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-610c2d04-3b43-4245-95a9-41042cbbebb5 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.158883 Sep 08 14:13:49.214187 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 603/1205] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:49 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 14:13:49.374694 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "name": "network-vif-plugged", "status": "completed", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:49.385339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:49.385821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:49.386251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:49.399463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] Creating event network-vif-plugged:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:13:49.405615 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-afcc2077-aa83-4a88-b182-cfac1fe18ff8 req-3314e4ae-d7d4-4136-a301-2b838ea2a6e9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 Sep 08 14:13:49.406419 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 603/1206] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:50.239859 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:50.240502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:50.247733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:50.248248 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:50.248687 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:50.249384 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:50.249839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:50.250270 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:50.586439 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:50.595673 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:50.597130 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:50.598295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-157f8882-aa59-4c96-8959-e4651af31b8c tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.362365 Sep 08 14:13:50.598860 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 604/1207] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:50 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:51.625895 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:51.626604 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:51.632992 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:51.633486 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:51.634412 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:51.640219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:51.640219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:51.640219 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:51.769151 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:51.778402 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:51.779921 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:51.781163 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-4aa0416a-f121-4f80-9d06-85a79d741e91 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.160122 Sep 08 14:13:51.781758 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 604/1208] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:51 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:52.808005 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:52.808639 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:52.815020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:52.819280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:52.819280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:52.819280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:52.819280 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:52.819733 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:52.951947 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:52.960495 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:52.961961 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:52.963152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-f92814ab-13fc-482c-bd5f-9bf8b81c1e8d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1729 microversion: 2.20 time: 0.160122 Sep 08 14:13:52.963754 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 605/1209] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:52 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:13:53.989134 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:53.989673 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:53.996905 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:53.997394 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:53.997833 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:53.998529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:53.999041 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:53.999473 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:54.131256 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:54.139539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:54.141078 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:54.142247 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-e132ba0e-ca58-40b6-aca0-e353567781e9 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1716 microversion: 2.20 time: 0.157277 Sep 08 14:13:54.142810 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 605/1210] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:13:53 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:09.084663 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:09.085164 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:09.088510 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=29 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:09.089179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:09.093987 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:09.094502 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:09.094946 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:09.095681 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:09.096162 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:09.096598 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:09.179172 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lazy-loading 'services' on Instance uuid e6d33920-d247-427b-bc5d-8def031bda80 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:14:09.447105 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-312b4c41-92aa-44e9-a20d-34567a68af66 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80/os-volume_attachments/7c4f1661-8218-45a0-a017-367e22ec279c" status: 202 len: 0 microversion: 2.1 time: 0.365505 Sep 08 14:14:09.447827 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 606/1211] 10.222.0.97 () {58 vars in 1416 bytes} [Thu Sep 8 14:14:09 2022] DELETE /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80/os-volume_attachments/7c4f1661-8218-45a0-a017-367e22ec279c => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:14:11.640053 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:11.640672 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:11.643203 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_api:SELECT=19 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:11.643911 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG dbcounter [-] [128400] Writing DB stats nova_cell1:SELECT=81 {{(pid=128400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:11.648865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:11.649345 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:11.649887 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:11.650586 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:11.651049 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:11.651545 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:11.676819 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:14:11.989526 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-adb36450-8ca4-4860-b65d-ef5eb5c1a6b1 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 204 len: 0 microversion: 2.1 time: 0.353129 Sep 08 14:14:11.990128 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 606/1212] 10.222.0.97 () {58 vars in 1239 bytes} [Thu Sep 8 14:14:11 2022] DELETE /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:14:11.999808 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:12.000550 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:12.006884 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:12.007403 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:12.007845 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:12.009079 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:12.009543 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:12.010017 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:12.144862 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:12.152957 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-917a11a7-7db0-46c8-a2ec-dc51286a1285 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1515 microversion: 2.1 time: 0.158177 Sep 08 14:14:12.153538 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 607/1213] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:11 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:13.177069 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:13.177781 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:13.184769 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:13.185255 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:13.185696 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:13.186395 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:13.186855 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:13.187286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:13.315796 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:13.324954 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-7f0575fd-2c04-424f-90af-220674fb571e tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1515 microversion: 2.1 time: 0.152078 Sep 08 14:14:13.325539 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 607/1214] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:13 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:14.347062 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:14.355035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:14.355035 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.355279 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.355537 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.356250 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.356699 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.357122 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.498298 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:14.506880 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-5705e5c0-7fd9-4d0b-8ebd-f101f4c9ca62 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1515 microversion: 2.1 time: 0.163673 Sep 08 14:14:14.507469 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 608/1215] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:14 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:14:14.548865 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d33920-d247-427b-bc5d-8def031bda80", "name": "network-vif-deleted", "tag": "08ecd00f-e343-476e-8046-709ba24684d8"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:14.559006 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.560687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.560687 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.573727 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] Creating event network-vif-deleted:08ecd00f-e343-476e-8046-709ba24684d8 for instance e6d33920-d247-427b-bc5d-8def031bda80 on hv-cinder-85646 Sep 08 14:14:14.578621 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-64d79273-599e-47f8-97dd-19fd9652154d req-c0f6be1e-34d2-4961-a6f0-6dde17d6f65a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 Sep 08 14:14:14.579529 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 608/1216] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:15.530092 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:15.530835 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:15.537373 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:15.547619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:15.547619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:15.547619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:15.547619 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:15.548043 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:15.572826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:15.573217 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:15.573658 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:15.574111 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.objects.instance [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lazy-loading 'fault' on Instance uuid e6d33920-d247-427b-bc5d-8def031bda80 {{(pid=128401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:14:15.622011 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8540a6f24149abbab456ca1c6b33c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cad599cd5943e8b545de7bacca6fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:15.630020 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-1d637635-5d6a-4be3-b0b4-8d3a6f61cc38 tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 200 len: 1309 microversion: 2.1 time: 0.103791 Sep 08 14:14:15.630617 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 609/1217] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:15 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:16.654669 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:16.655263 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] [instance: e6d33920-d247-427b-bc5d-8def031bda80] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:16.661510 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:16.661999 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:16.662438 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:16.663133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:16.663633 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:16.664061 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:16.677774 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] HTTP exception thrown: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Request method failure captured: Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 HTTP/1.1 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfgk9rZ05gpNG888LnJB7in8mwOeHlbq0UodMlyIB7f4w_KzuExM_jyLORe6OJeGJPrML_Kjzu1NmOeQt18mWBvx3epM_Pm1ZLIpzXCSDGqp0IXXf3SSy3T5K2ZjtMV7M9ltKjWImNtZ1JkATIyZaeHH7pkDt5WYGlVWl8gJbussv_A Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: d3cad599cd5943e8b545de7bacca6fe1 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:16.679470 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d3cad599cd5943e8b545de7bacca6fe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_d3cad599cd5943e8b545de7bacca6fe1", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: d3cad599cd5943e8b545de7bacca6fe1 Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2141585415 Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesSnapshotTestJSON-2141585415-project Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: ae8540a6f24149abbab456ca1c6b33c7 Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesSnapshotTestJSON-2141585415-project Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. Sep 08 14:14:16.681824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'e6d33920-d247-427b-bc5d-8def031bda80'} Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:16.683123 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. Sep 08 14:14:16.684794 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:16.686213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] Returning 404 to user: Instance e6d33920-d247-427b-bc5d-8def031bda80 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:16.686213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-86f77465-a74c-432f-bb4b-a6348bf2280b tempest-VolumesSnapshotTestJSON-2141585415 tempest-VolumesSnapshotTestJSON-2141585415-project] 10.222.0.97 "GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80" status: 404 len: 111 microversion: 2.1 time: 0.031822 Sep 08 14:14:16.686213 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 609/1218] 10.222.0.97 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:16 2022] GET /compute/v2.1/servers/e6d33920-d247-427b-bc5d-8def031bda80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:14:26.148771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:26.150998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:26.154204 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_api:SELECT=10 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:26.154343 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG dbcounter [-] [128401] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=128401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:26.159157 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.159645 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.160090 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.160831 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.161292 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.161734 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.191499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-e63443ba-8804-4c86-b10f-42c80d195100 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046761 Sep 08 14:14:26.192210 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 610/1219] 10.222.0.97 () {60 vars in 1343 bytes} [Thu Sep 8 14:14:26 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:26.259735 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:26.262224 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:26.266751 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.267229 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.267662 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.268384 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.268824 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.269239 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.295286 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Going to try to terminate instance {{(pid=128400) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:14:26.800776 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-6da6031f-f18f-4e5b-a7ab-a394e01777e4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 204 len: 0 microversion: 2.20 time: 0.544502 Sep 08 14:14:26.801402 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 610/1220] 10.222.0.97 () {60 vars in 1280 bytes} [Thu Sep 8 14:14:26 2022] DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 14:14:26.810537 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:26.811159 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:26.821497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.821497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.821497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.821497 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:26.821950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:26.821950 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:26.952698 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:26.987239 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:26.987239 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:26.987239 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-4323d52c-bba7-44a6-9508-196ae82d4916 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.157264 Sep 08 14:14:26.987655 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 611/1221] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:26 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:27.994133 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:27.995306 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:28.002463 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:28.002958 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:28.003464 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:28.004224 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:28.004679 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:28.005101 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:28.137321 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:28.146299 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:28.148972 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:28.152210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-3c55bf93-9b5d-4617-bb53-a5a26e1e2736 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1722 microversion: 2.20 time: 0.164166 Sep 08 14:14:28.152210 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 611/1222] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:27 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:29.176045 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:29.176771 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:29.183352 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:29.183844 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:29.184307 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:29.185014 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:29.185474 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:29.185903 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:29.262149 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:29.271993 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:29.275417 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:29.276701 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3090a040-d469-4e27-8c9d-5ce85e920358 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1655 microversion: 2.20 time: 0.105158 Sep 08 14:14:29.277258 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 612/1223] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:29 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:29.524553 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6b1f56-d487-4959-80b9-9d0de157c020", "name": "network-vif-deleted", "tag": "2eb83569-a0d0-4a14-925a-a80435f2b2dd"}]} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:29.535457 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:29.536348 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:29.536537 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:29.548903 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.compute.server_external_events [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] Creating event network-vif-deleted:2eb83569-a0d0-4a14-925a-a80435f2b2dd for instance cf6b1f56-d487-4959-80b9-9d0de157c020 on hv-cinder-85646 Sep 08 14:14:29.553839 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [req-20468ee0-c0a5-4534-98a9-c307213e732e req-2d489748-5838-4359-bc67-e32e89c26d45 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033379 Sep 08 14:14:29.554454 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 612/1224] 10.222.0.97 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:30.302203 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:30.302830 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:30.310181 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:30.310666 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:30.311106 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:30.311828 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:30.312336 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:30.312763 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:30.377803 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:30.386376 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:30.387833 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.policy [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128401) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:30.389049 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-2eaa5c21-209b-47ee-829d-5b7669d5c21d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1655 microversion: 2.20 time: 0.090839 Sep 08 14:14:30.389969 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 613/1225] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:30 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:31.415581 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:31.416313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:31.422695 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:31.423179 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:31.423616 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:31.424361 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:31.424821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:31.425251 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:31.490974 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:31.499994 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:31.501589 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.policy [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f5e920d3b3044859b767add41690043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe0ab206094524af0fdde9e6285385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128400) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:31.502746 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-61f1bd04-fdae-499b-9b20-bd977faad9fa tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 200 len: 1366 microversion: 2.20 time: 0.091958 Sep 08 14:14:31.503339 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 613/1226] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:31 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 14:14:32.527549 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:32.528186 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:32.534798 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:32.535344 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:32.535775 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:32.536500 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:32.536954 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:32.537568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:32.552998 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 HTTP/1.1 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:32.554670 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:32.557152 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'cf6b1f56-d487-4959-80b9-9d0de157c020'} Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:32.558433 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:32.560295 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:32.561826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:32.561826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-3cde1a32-2ea9-4714-a551-e5b763897d1d tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 404 len: 111 microversion: 2.20 time: 0.033009 Sep 08 14:14:32.561826 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 614/1227] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:32 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:32.565821 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b05c4bad-669a-436d-b86e-772058c86099 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '.version_select at 0x7f7f8b13dca0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:32.682085 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b05c4bad-669a-436d-b86e-772058c86099 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636180860" status: 204 len: 0 microversion: 2.20 time: 0.120075 Sep 08 14:14:32.682690 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 614/1228] 10.222.0.97 () {60 vars in 1262 bytes} [Thu Sep 8 14:14:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636180860 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 14:14:34.881288 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:34.881825 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:34.888857 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:34.889347 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:34.889789 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:34.890488 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:34.890953 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:34.891388 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:34.904897 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 HTTP/1.1 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:34.906499 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.908182 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'cf6b1f56-d487-4959-80b9-9d0de157c020'} Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:34.909402 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.910736 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.912553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:34.912553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-535e5a38-781f-4816-8c8c-19a5016b60b4 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 404 len: 111 microversion: 2.20 time: 0.030480 Sep 08 14:14:34.912553 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 615/1229] 10.222.0.97 () {60 vars in 1280 bytes} [Thu Sep 8 14:14:34 2022] DELETE /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:34.917201 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:34.917840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: cf6b1f56-d487-4959-80b9-9d0de157c020] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:34.924462 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:34.924937 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:34.925364 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:34.926051 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:34.926500 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:34.926921 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:34.941234 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 HTTP/1.1 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:34.942886 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.945045 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'cf6b1f56-d487-4959-80b9-9d0de157c020'} Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:34.946507 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. Sep 08 14:14:34.947841 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:34.949367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance cf6b1f56-d487-4959-80b9-9d0de157c020 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:34.949367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-5c417d15-54be-4360-b00a-5210cddd0e99 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020" status: 404 len: 111 microversion: 2.20 time: 0.031447 Sep 08 14:14:34.949367 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 615/1230] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:34 2022] GET /compute/v2.1/servers/cf6b1f56-d487-4959-80b9-9d0de157c020 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:36.301712 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:36.302275 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.compute.api [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128401) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:36.309659 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:36.310145 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:36.310584 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:36.311293 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:36.311751 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:36.312220 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG oslo_concurrency.lockutils [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:36.327568 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 HTTP/1.1 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:36.329188 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: > Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.331064 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'f4b5a76e-6957-466c-bf07-13e01fd80403'} Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:36.332044 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.333774 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.335555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:36.335555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ccb26baf-8a3b-4628-a333-19994691a7e2 tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 404 len: 111 microversion: 2.20 time: 0.032809 Sep 08 14:14:36.335555 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 616/1231] 10.222.0.97 () {60 vars in 1280 bytes} [Thu Sep 8 14:14:36 2022] DELETE /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:36.339509 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Calling method '>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:36.340182 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.compute.api [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] [instance: f4b5a76e-6957-466c-bf07-13e01fd80403] Fetching instance by UUID {{(pid=128400) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:36.346831 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:36.347313 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:36.347754 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:36.348490 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Acquiring lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:36.348952 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:36.349387 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG oslo_concurrency.lockutils [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Lock "1ddabd24-226a-4d6c-890f-c80b419c7ead" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:36.365668 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] HTTP exception thrown: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Request method failure captured: Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 HTTP/1.1 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfdSog9rh_-hbDrVarF0HEovdTZRgnPk6PaZmMt-qPzFIgq57WgU_9k_wqBV_t_JQXG8LdiFHIzIraBVMXvzcQiZOvKkiTV0OezgxGKje0KRyfNUhVchrgd7I7DMdpJzufxQKDdxeg5Q9sTUjYIQRLR4I56N1-27OW6LL8ww4HtIRjE Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:36.367728 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1abe0ab206094524af0fdde9e6285385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1abe0ab206094524af0fdde9e6285385", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 1abe0ab206094524af0fdde9e6285385 Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363312172 Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: f5e920d3b3044859b767add41690043c Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363312172-project Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: > Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.369614 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'f4b5a76e-6957-466c-bf07-13e01fd80403'} Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:36.370719 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. Sep 08 14:14:36.372357 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:36.374095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] Returning 404 to user: Instance f4b5a76e-6957-466c-bf07-13e01fd80403 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:36.374095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-f7420303-a105-4000-97bb-81716d6d9e6f tempest-AttachVolumeShelveTestJSON-363312172 tempest-AttachVolumeShelveTestJSON-363312172-project] 10.222.0.97 "GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403" status: 404 len: 111 microversion: 2.20 time: 0.033844 Sep 08 14:14:36.374095 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 616/1232] 10.222.0.97 () {60 vars in 1277 bytes} [Thu Sep 8 14:14:36 2022] GET /compute/v2.1/servers/f4b5a76e-6957-466c-bf07-13e01fd80403 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 14:14:42.416839 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ff101c2d-cbae-41af-b5ca-1bcfbc2ea2f5 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Action: 'create', calling method: .version_select at 0x7f7f8b2e1ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-89749137", "metadata": {"Type": "work"}}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ff101c2d-cbae-41af-b5ca-1bcfbc2ea2f5 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 120 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:42.433349 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-89749137", "metadata": {"Type": "work"}}} Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: Sep 08 14:14:42.435095 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-89749137', 'metadata': {'Type': 'work'}}}} Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.436972 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:14:42.438748 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:14:42.440179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 14:14:42.440179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.440179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ff101c2d-cbae-41af-b5ca-1bcfbc2ea2f5 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.440179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ff101c2d-cbae-41af-b5ca-1bcfbc2ea2f5 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132920 Sep 08 14:14:42.440179 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 617/1233] 10.222.0.97 () {60 vars in 1156 bytes} [Thu Sep 8 14:14:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:42.445480 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b97e0d3d-9a98-402f-8c9a-8a5e02a11dd8 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Action: 'create', calling method: .version_select at 0x7f7f8ac88790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1055713441", "metadata": {"Type": "work"}}} {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b97e0d3d-9a98-402f-8c9a-8a5e02a11dd8 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 120 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:42.450108 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1055713441", "metadata": {"Type": "work"}}} Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:14:42.452406 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1055713441', 'metadata': {'Type': 'work'}}}} Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi '0' Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.453444 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:14:42.455117 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:14:42.456691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 14:14:42.456691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.456691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-b97e0d3d-9a98-402f-8c9a-8a5e02a11dd8 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.456691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-b97e0d3d-9a98-402f-8c9a-8a5e02a11dd8 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010184 Sep 08 14:14:42.456691 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 617/1234] 10.222.0.97 () {60 vars in 1156 bytes} [Thu Sep 8 14:14:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:42.464061 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ceabb849-9baf-4b3b-8e63-2c1d0f55355e tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Action: 'create', calling method: .version_select at 0x7f7f8b3d25e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2087850117", "metadata": {"Type": "work"}}} {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ceabb849-9baf-4b3b-8e63-2c1d0f55355e tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 119 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:42.467679 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2087850117", "metadata": {"Type": "work"}}} Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: Sep 08 14:14:42.471429 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2087850117', 'metadata': {'Type': 'work'}}}} Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise error Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi '' Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.472990 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 14:14:42.475125 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 14:14:42.477638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 14:14:42.477638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.477638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-ceabb849-9baf-4b3b-8e63-2c1d0f55355e tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.477638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-ceabb849-9baf-4b3b-8e63-2c1d0f55355e tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011045 Sep 08 14:14:42.477638 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 618/1235] 10.222.0.97 () {60 vars in 1156 bytes} [Thu Sep 8 14:14:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 14:14:42.480091 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-363ce421-c681-45dd-966e-8c2e120dfbb0 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Calling method '.version_select at 0x7f7f8aced310>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:42.511757 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-363ce421-c681-45dd-966e-8c2e120dfbb0 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] HTTP exception thrown: Volume tempest-invalid-1033932737 could not be found. Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-363ce421-c681-45dd-966e-8c2e120dfbb0 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1033932737 HTTP/1.1 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:42.513941 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Volume tempest-invalid-1033932737 could not be found. Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': 'tempest-invalid-1033932737'} Sep 08 14:14:42.516840 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1033932737 could not be found. (HTTP 404) (Request-ID: req-f135cc4d-b60c-4064-95e2-faf58e5040e9) Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.520112 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:14:42.524096 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1033932737 could not be found. Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:42.526827 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1033932737 could not be found. Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1033932737 could not be found. Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-363ce421-c681-45dd-966e-8c2e120dfbb0 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 404 to user: Volume tempest-invalid-1033932737 could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-363ce421-c681-45dd-966e-8c2e120dfbb0 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1033932737" status: 404 len: 99 microversion: 2.1 time: 0.040835 Sep 08 14:14:42.529557 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 618/1236] 10.222.0.97 () {58 vars in 1218 bytes} [Thu Sep 8 14:14:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1033932737 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 14:14:42.531445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-7850c2c7-9d36-490f-9afc-cdf90bb78386 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003720 Sep 08 14:14:42.531445 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 619/1237] 10.222.0.97 () {58 vars in 1140 bytes} [Thu Sep 8 14:14:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 14:14:42.540828 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-9dc5e97e-6e22-41da-ba0b-8be97e0a4ac3 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004395 Sep 08 14:14:42.541335 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 619/1238] 10.222.0.97 () {58 vars in 1137 bytes} [Thu Sep 8 14:14:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 14:14:42.552577 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-56676ecc-4b15-4b49-b92d-fd523a06a4fd tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Calling method '.version_select at 0x7f7f8b131af0>' {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:42.581228 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.wsgi [None req-56676ecc-4b15-4b49-b92d-fd523a06a4fd tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] HTTP exception thrown: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-56676ecc-4b15-4b49-b92d-fd523a06a4fd tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: request: DELETE /compute/v2.1/os-volumes/aced366f-8e56-4d26-9876-c46d900afbcd HTTP/1.1 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept: application/json Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Accept-Encoding: identity Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Connection: close Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Length: 0 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Content-Type: application/json Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Host: 10.222.0.97 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: Openstack-System-Scope: None Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Id: None Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Domain-Name: None Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Identity-Status: Confirmed Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Is-Admin-Project: True Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Id: default Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Domain-Name: Default Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Role: reader,member Sep 08 14:14:42.583166 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Roles: reader,member Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Id: default Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Domain-Name: Default Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: method: Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: exception: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: action_args: {'id': 'aced366f-8e56-4d26-9876-c46d900afbcd'} Sep 08 14:14:42.584877 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: {{(pid=128401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. (HTTP 404) (Request-ID: req-518e4ab6-b76c-43b3-a455-482fd8cd2547) Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.586482 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 14:14:42.588323 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 14:14:42.589744 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: DEBUG nova.api.openstack.wsgi [None req-56676ecc-4b15-4b49-b92d-fd523a06a4fd tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 404 to user: Volume aced366f-8e56-4d26-9876-c46d900afbcd could not be found. {{(pid=128401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: INFO nova.api.openstack.requestlog [None req-56676ecc-4b15-4b49-b92d-fd523a06a4fd tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/aced366f-8e56-4d26-9876-c46d900afbcd" status: 404 len: 109 microversion: 2.1 time: 0.035704 Sep 08 14:14:42.591328 dv-cinder-856463-2-iscsi devstack@n-api.service[128401]: [pid: 128401|app: 0|req: 620/1239] 10.222.0.97 () {58 vars in 1248 bytes} [Thu Sep 8 14:14:42 2022] DELETE /compute/v2.1/os-volumes/aced366f-8e56-4d26-9876-c46d900afbcd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:14:42.597200 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-62beac6c-e476-4b71-b6dd-df4ffcc5ee72 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Calling method '.version_select at 0x7f7f8ac881f0>' {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:42.622347 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.wsgi [None req-62beac6c-e476-4b71-b6dd-df4ffcc5ee72 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] HTTP exception thrown: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-62beac6c-e476-4b71-b6dd-df4ffcc5ee72 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Request method failure captured: Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: request: GET /compute/v2.1/os-volumes/865ebe03-89bd-4a5b-9485-6aa827176fbd HTTP/1.1 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept: application/json Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Accept-Encoding: identity Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Connection: close Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Length: 0 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Content-Type: application/json Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Host: 10.222.0.97 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: Openstack-System-Scope: None Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: User-Agent: python-urllib3/1.26.12 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Auth-Token: gAAAAABjGfjSiCzgTfKTK8vVNSGjevX0w_O0GrXu1hWwAvhE2ozDWA-apwueG_vNR8D0zMjqhUdj3XykI_5Hpou2iZJorNrWXF7rdppPS0BCoQbWgFQvFTFj5gXaibZrFMNado2xpj5yddaz25y4125wYWqDCU-e1l3DVwgmFuuSXnKgbq1HlMI Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Id: None Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Domain-Name: None Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Identity-Status: Confirmed Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Is-Admin-Project: True Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Id: default Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Domain-Name: Default Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Project-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Role: reader,member Sep 08 14:14:42.624326 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Roles: reader,member Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2cc0861d0fab40d6913e832cccdab553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2cc0861d0fab40d6913e832cccdab553", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}] Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Id: 2cc0861d0fab40d6913e832cccdab553 Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-Tenant-Name: tempest-VolumesNegativeTest-848270674 Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Id: default Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Domain-Name: Default Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Id: c4cc27d0544b49ceaf2e95aee1f1b841 Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: X-User-Name: tempest-VolumesNegativeTest-848270674-project Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: method: Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: exception: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: action_args: {'id': '865ebe03-89bd-4a5b-9485-6aa827176fbd'} Sep 08 14:14:42.626039 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: {{(pid=128400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. (HTTP 404) (Request-ID: req-848b7b11-829d-4fbc-9c5e-6a6af30e1d30) Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.627067 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 14:14:42.628368 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 14:14:42.629650 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: ERROR nova.api.openstack.wsgi Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: DEBUG nova.api.openstack.wsgi [None req-62beac6c-e476-4b71-b6dd-df4ffcc5ee72 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] Returning 404 to user: Volume 865ebe03-89bd-4a5b-9485-6aa827176fbd could not be found. {{(pid=128400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: INFO nova.api.openstack.requestlog [None req-62beac6c-e476-4b71-b6dd-df4ffcc5ee72 tempest-VolumesNegativeTest-848270674 tempest-VolumesNegativeTest-848270674-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/865ebe03-89bd-4a5b-9485-6aa827176fbd" status: 404 len: 109 microversion: 2.1 time: 0.034711 Sep 08 14:14:42.630917 dv-cinder-856463-2-iscsi devstack@n-api.service[128400]: [pid: 128400|app: 0|req: 620/1240] 10.222.0.97 () {58 vars in 1245 bytes} [Thu Sep 8 14:14:42 2022] GET /compute/v2.1/os-volumes/865ebe03-89bd-4a5b-9485-6aa827176fbd => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)